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ABSTRACT 

Eight public libraries participated in a two-=year 
experiment to investigate the potential of the public library as a 
"linking agent" between the public and the many machine-readable data 
bases currently accessible using 6n line computer terminals. The 
investigation covered users of the service^ impact on the library r 
conditions for successful use of on line reference services^ and 
financial and marketing aspects of such a serTice, It was founa thati 

(1) the public library can be an effective provider of on line 
retrieval services^ (2) allocation of reference service staff time is 
one of the most important factors in the success of the service^ (3) 
on lin^ searchers must complete some "critical mass" of searches each 
month to maintain their search skills, (4) the attitude of the head 
reference librarian affects the speed and efficiency of the service, 

(5) there is a segment of the public that is willing, to pay^for on 
line searches, and (6) provision of an on line search servie^ does 
not in the short term alter the public image of the library J (JY) 
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FOREWORD 

This report presents the results of the first 2 years of the DIALTB^ project, a study 
supported by the National Scionce Foundation, * to investigate online search in a public 
library setting. We have attempted to capture not only tha formal eyaluative material, 
but also the very valuable Infnrmal comments expre.ss§d-by^^ffi;clpants. (See 
Appendbc B. ) 

The report is given in three volumes i 

Main Re|3Qi^t. The present voluine de?icribes the project, mid summarizes the 
evaluation and publicity material given in the Annexes, 

Aimex 1: Evaluation, This Annex presents toe detailed project evaluation prepared 
by Applied Commuiiicatlon Research. It provides extensive statistical tables, and 
detailed analj^ses of the results obtained. 

Annex 2: Publicity. This Annex presents the publicity plan, evaluation matexnal 
pertinent to publicity, comments of participants regarding publicity, and many 
examples of the publicity used. 

Copies of the main report aiid the annexes are available from Lockheed Information ' 
Systems while the supply lasts, and thereafter from the National Technical 
Information Service (NTIS) and ERICt^ ^ 



*Graiit SIS74-13972, User Siipport Program, Divlsionof Science ^taformation, NSF, 
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ABSTRi\GT 

This report describes tlie first 2 years of aii experiment that investigated the potcntiDl 
of the public librarj^ as a ^ ^linking agent'' between the public and the mwiy machine- 
readable data bases currently accessible via the telephone line using onlliie terminals. 
Four public libraries in Nortliern California, members of the Cooperative Information 
Network (CIN), were the original participants in the study; four additional libraries 
in other paints of the comitry wore introduced in the middle of tlie second year. 

The study investigated the following questions- , 

m Is online search of use to the patrons of a public librai\y ? 

m Wliat impact does such a system have on both the library and tiie patron? 

m Wliat conditions are required for successful use of online reference seareh 

in the public library? 
m What are the financial and mai^kcting aspects of such sci^ice? 

The investigation was conducted by Ixjcldieed Biformation Systems, and Locklieed 
also providod tlie DIALOG - online search serviee* Evaluation was performed by 
Applied Communication Research, a nonprofit behaviorarresearch firm in Palo Alto, 
California. The project was reviewed by an Oversight Comiiiittee of five expert? in 

various specialities of public libraiianship, marketing, and information science, 

; \ 

Some general conclusions suggested by the evaluation data are^ 

(1) The public library can be an effective chaiiiiel through which to provide m 
online retrieval service, but libraries are not ^1 equally well suited to 
provide such service* . 

(2) The allocation of reference service staEf time is one of the most important 
factors to be considered in planning an online s irch service. 

' V , 
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(3) To maiiitain seai'ch proficiency, online searchers must complete some 
'^critical mass'^ of searches en.oh month in each data base for which 
prpficienc5^ is desired; the large number of different data bases makes it 

= difficult for an individual to maintain a thorough loiowledgo of each data 
base. 

(4) The attitude of the head reference Hbrarian toward online retrieval affects 
the speed and efflclency witli which searches are completed, 

(5) Fee^for ^service did not bring the problems tiiat maiiy librarians had feared; 
tiiere is a segment of the public willing to pay for such search service ^ and 
fee collection Is straightforward- 

(6) The provision of online search has done little In the short term to alter 
the image of the public library in the community it services. 

The original 2-year study was extended to a tiilrd yeai' to obtain evaluation data on 
tiie impact of charging patrons for tiie full cost of online sear cli service j as well as . 
to develop a more complete cqnceptaal frajnework for the stidy* The present interim 
report tlierefors only describes the first 2 years of tiie experiment; -tiie final report 
wlir be availai^le in .the Fall of 197'7 
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Section 1 
DESCRIPTION OF THE STUDY 

It is now possible to perform online coiiiputor aQarches of large bibliographio data 
bases ranging from one-^quai^ter of a million to a million citations each. These data 
bases span the spectrum frc science and technology to social sciences and business. 
Several retrieval services such as the Locklieed DIALOG system and the Systems 
Development Corporation's ORBIT system offer such service at rates ranging fr^om 
$35 to $150 an hour, depending on the data base used. In addition, the user must 
pay the communication cost (the cost of a direct telephone call to California or 
approximately $10 an hour via a local Tymshare or Telenet port) and terminal rental 
cost (appi^oximateh^ $150 a montlij including maintenarice), 

A decade ago, such online access to large bibliographic databases was restricted to 
large governmental organizations that had the financial assets needed to prepare largo 
databases and to access them in an efficient manner p As a result of reduced computer 
and commimications costs, this access has been extended to Industrial users and 
universities at a reasonable cost tfirough more than 15 services in the United States 
(Ref, 1). As yet, however ^ no extensive use of these services is made by the general 
public. What is required, as shown schematically iji Figt 1=1, is a ^'linldng agent to 
bring together the data base resources and the general user public. 

1 . 1 THE DIALIB STUDY 

In late 1973,^ Lockheed Information Systems submitted a proposal to the National 
Science Foundation to conduct a study to examine means by which the public library 
could act as a li-^iing agent to Uie general public in providing online information 
retrieval servic: 

In 1974 j the User Support Program of tlie Office of Science Information Service, 
National Science Foundation, established a grant to enable Lockheed Information 

t 

■ 1-1 
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Systems to work with the Cooperative Information Network (CIN), an information 
cooperative In Northern California, to establish onjme search services using the 
DIALOG System (see Appendix A) in four Cooperative Information Network public 
libraries- The project is referred to as ttie DIALIB project. A nonprofit behavioral 
research fir jm in Palo Alto, California, Applied Communication Research, Inc* (ACR) 
was selected to perform m independent project Evaluation, . 

^The NSF grrjit summary was as follows^ 

The purpose of Uiis prolect is to conduct an operational experiment to test 
the feasibility, economic viability, and utility to users of using the existing 
library systems to provide public access to cumputerized (online) scientific 
and tedhnical information services (query, search, aiid retrieval) hereto- 
fore unavailaBle and inaccessible to eitlier the general public or the scien- 
tist/engineer in smaller organizations; and to determine the impact oi such 
services on both libraries and service users. The projoct entails a two- 
year program to be carried out in several libraries of the^ Cooperative 
Iniormation Network of San Mateo Md Santa Clara Counties in California. 
The online retrieval capability,' which will be provided by the. Locldieed 
DIALOG system, oJHers access to a wide range of engineering^ science, ^ . 
psycholugy, agricutture, and educational teclmology databases, including^ 
NTIS, CAIN, ERIC, INSPEC, COMPENDEX, ajid PANDEX. Statistical €ata . 
are to be collected and analyzed with respect to (1) utility and utUlzation 
of, public libraries^ as technical information dissemination centers ^ aiyd . 
(2). marketing vai^iables and marketing metiiods for motivating new users 
bt services providing online access to sclent^ic and technieal inform toon, 
Basic study areas include the investigation and analysis of the financial, 
administrative^ user Jtechnlcal, and marketing aspects of computerized 
online Information seijvioes in relation to other librai'y services. 

ThUH, somu of the obJectlvoB of the study were the follo^A^ing: 

(1) Deiorraine how uselul an online retrieval bqvHx^q is in meeting the^needs 
of the general public i ^ ' , 

(2) Develop a user profile that will assist library administratorsin idenM%ing>' 
the principal users of the system, the ability of patrons to; pc^ f6r systenr 
iisCj and the tyiio of information patrons require. . . - 

(3) Examlno the pffeut of the online service on the library rofo^nce service 
luid isolate causes for acceptance or rejection of the Borvicty 

(4) Detcrmina the actual costs of proWding such a service and outline the 



factors contributing to those costa^. 
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(5) Identify the specific characteristics of diflerent libra,ries which would have 

an effect on the operation. ' 
• i. - 

m September 1976, the National Science Foundation extended the time period one 
additional year so that we could obtain evaluation data on the impact of charging 
pati'ons for the full cost of search, as well as to develop.^a'more complete conceptual 
framework for the study. The present 2-^year mterim^^eport therefore only describes 
the first 2 years of tiie experiment; tlie final report will be available in the Fall of 1977. 

It must be kept in mind tJiat the experiment involved public libraries operating under 
different administrative policies and not under strict experimental control. Thus, 
^ when we try to commimicate tiie results of tiie study, we are lilce tlie blind nieh. in the 
fable, each touching a different part of the elcphajit, and trying to communicate the 
nature of the creabare to others, 

- . ■ : « ^ ■ 

1.2 'DESIGN,,0F THE STUDY 

The study was designed as a 2-yeai^ study in which thu first year of online seiM^lce was 
to be provided at no cost to tlie libraries, aiid the second year was to bp at ohe^half , - 
the usual ch^^ge for search time* The four CEN-member ^public Ubrarics were to 
determme how the funds for the seGond-yeai^ operation were to be raised. Because 
of severe budget cuts experienced by these libraries, tliey all chpsc to pass the 
online search service costs on to the patron, svhile tiiey paid for library persomiel 
and communication costs, (The terminal rental was paid by the grant.) 

The libraries each determinedshow the online service was to be integrated into their . 
systen^. Since each of the libraries was in a different county/city Jurisdiction , mid 
was oriojiized somewhat differently from the otJiers, difforent approaches were taken 
to serving the pubUc, There was, Uiereforq, vai4ation found in the evaluation data 
from librai^y to library, and this variation is discussed in Annox 1, Evaluation Report. 

11 
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1.2.1 Project Coordination 

Di the early stages of tlie project, niontlily review meetings were held to iron out ^ 
difficulties and to review the ACR evaluation rec^irements, but by the second year 
very few meetings were required. The libraries also submitted monttily reports to 
Ijocldieeds indicating problems, c^erience with the system , and suggestions, and 
these reports wiere then circulated to all the pai^ticipatliig libraries. 

1.2.2 Publicity ' ' - 

Public libraries have always . had the. problem of publicizing,^ . . \ 

Uie attention of potential patrons, Wltii the inception of online retrieval service,. and 
paiticulai^y with fee-abased search, tirls becomes an even greator prol^lGni, 

Early in the project it was realized that a publicity expert was required to coordinate 
and develop publicity for the onlin| service, , and the CIN Online doinmlttee recommended 
Mrs. Evelyn Helmer, Public Infor'mation, San Mateo County Library, Her four- 
stage publicity plan is given in Appcndtx D imd the publicity material developed iS / 
given in Annex 2, , 

1.2.3 Librariaii Training . 

Librarimis from each of tiie participating libraries were given the standard Lqcldieed 
2-'day training course, and they spent about 1 montli familiai'izlng tliemsolvcs with 
the system before dealing with patron searches* As time went by^ skilled seai'chcrs 
left and others wore trained to talce their place, usually by sending them to the 
LocJdieed training program* ' In addition, librai^ans attended special data base 
presentations, such as thofee given by Prodicastl or by Biosciences Information 
Sei'vlce (BIOSIS) in nearby cities. 

Searchers received the DIALOG Chronolog, a nionlihly inibllcation describing thci^^ 
latest features of the system, offering hints on system use, and indicating chai^aotcr^ 
Istics of the latest data bases available. They also rooclvcd "DIALIB Notua, an 
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Inforinal series of notes. that discussed tiieir common mlstaJces in searching, new 
data bases, and Interesting search techniques. During the pay period, seai'ches 
were reviewed and the results of tMs review were disoussBd in these DIALIB notes, 
(See Appendtx E for common errors found in searches..) 

It must be kept in mind that DIALOG was in a period of rapid expansion duriiig this 
2-year period, during which ijime the number of data bases increased from about 
13 to over 35. Thus, in some of the remarks of the partieipatlng librariajis given 
Ln Appendix B, one will find statements about the lack of time they had to keep up 
with this rapid growth. 

1.3 ROLE OF THE STUDY PARTICIPANTS 

■ i 

The following prganizations' participated in the study. Their specific responsibilities 
with regard to the study are indicated. - - . 

m Joint Board of the Cooperative Information Network f GIN) . Cm is an organization , 
consisting of representatives of public and private ilbraries in San Mateo and 
Santa Clara Counties, in California, SvlUch has been in existence for nenr-ly 5 years. 
Its purpose is to deal with mutual problems, share information resources, and 
coordinate joint activities of tiie member libraries^. The role of the Joint Board 
of CIN in tlie present study was to review overall progress of tlie study, and maJce 
policy decisions, as required. - . , 

a CIN Online Retrieval Committee. This committee was appointed by the CIN Board 
to act as liaison with Lockheed Information Systems. The Online Committee ^. 
consisted of Mrs. Patricia Bcrgsing, Burlingame Public Library, and Mr. DotJald 
Fuller, Santa Clara (City) Public Library. 

e Locklieed Information Systems . Under Dr. Roger K. Simmiit, Pi'ojoct Director, 
and Mr. Oscar Firscheih, Principal Investigator, Lockheed provided the overall 
managemerit, technical g-uldance, and coordination. In addition, Lo'ckheed was- 
rosponslbleTor providing the DIALOG online rotrioval 'service, and training of 
library personnel. Lockheed prepared periodic reports for tlao NationiU Science 
Foundation, conductod review meetings, imd reviewed soM-ches p'erformod by tlio 
libraries. . , 

10 
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m Applied CQmmunlcatiQn Huscivrch . Project cviiluatiori was tiic responsibility of Dr. 
Alice Ahlgren of Applied Commarucation Res Inc;, a Palo Alto nonprofit be- 

Imvioral research firm. She was responslblG for^preparatlon of the evaluation toolSj 
coordination with the libraries concerning their use, and analysis and reporting, on 
the i^e suits, » 

« Oversie:ht Committee . To review tlie pi^ogress of the experiment, an Oversight 
Committee consisting of imrDartial exi^erts in the field of ;eKperimental design, 
public library administration; and user studies was formed. The committer 

• consisted of Professor A, Rubenstein (Noraiwestern University), Mrs* Virginia 
Ross Gcller (Geller imd Ross), Professor Charles Bourne (Unlvei^sity of California^ 
Berkeley), ^ Mr Forrest Carha^rt (METRO), and Mr. Douglas Ferguson (Stanford 
Libraries). , ^ > . [ . 

9 CIN Libraries . In June 1974, the CIN Board selected four libraries for die expori- 
' mentj with each library representing a somewhat different type of library SGrvico: 

a large city (San Jose Public Library); a county library in a suburban area (Santa 
Clara County Library ut Cupertino); a county library with no walk-in traffic (San 
Mateo County library, Belmont); and a smaller city library witli much walk-^in busi- 
ness (Redwood City Public Library). The libraries provided the services of the 
reference librarians, paid for communlcaiipns costs ^ and provided space for the 
tormmals. In addition, the librarians gave talfes and presentations to various 
civic and govornmentaVorgariizations to publicise the service. Figures 1-2 and 1-3. 
show the terminal locations in the four GIN libraries. All but the SiJn Matep County > 
installation are in patron areas. ^ 

9 Non-CIN Libraries , After the first yuar, the NSF Buggested that Uic experiment 
be exiianded to include those libraines able to deal with nonsubsidized search* The ■ 
iiitent was to obtain experionee in jKissing the fidl cost of the seai'ch on to the public 
library. New libraries would bu given free demonstration time and a free terminal 
for a 0-nionth period, but would bu billed at hdl cost of a DIALOG search, Tim 
libraries could then pass thip cost on to the patron, if there was no internal budget 
to support tl;is service. Tills would ])roviclo dcita on tho, adcoi)tnncc of a ruU-chai-gcj 
syatara by tl\u publlo. Four public iibrttricH tigrood to jiartloliiuto In Uio projcut: 
■"MlniKSniralia I'ubllc Tdbrnry (INFORM); Clovolnnd PubUd-.Li])r?i;!'y (FACTS FOR A 
FKK); Houston IHibllo Library; nnri tlio X^m iHlnnd Library Hosouroos Council. A 
completo cles(!rl])tion ol thoatj TlbriU'luH imd tlitsir piu-ticlpatlon is given In AppondLx A 
of Antiux 1 . e. -i '7 ■ 
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1.4 PROJECT CHRONOLOGY ■ ^ 

The highlight events of tiie project are given belosv* Details were given m tiio 
Quarterly Reports indicated. A list of project meetings and papers, presented is 
given in Appendbc G* .j, 

June -Au^st '1974 (First Quarterly Report) -:^ 

^•■'^ /- '"'^ J ■ 

m" Participattag libraries selected by CIN Boajd* \ 

m Legal agi'e^ments prepared and sipied between the libraries and Loqkheed, 
m Oversight Committee selected, and had first meeting at Locldieed Palo Alto 

Research Laboratory, ^ 
m Opening ceremonies the km Jose Public Library, with attendant publicity, 
m Meeting with heads o^ participating libraries regarding pricing policy for 
- second year * 

d Bist^lation of terminals , training of library personnel , and Initial, operation. 

September - November 1974 (Second Quartferlv Report) , _ 

m User evaluation b^pm by AGR with distribution of questlonalres and forms * 

0 Problems arise because high'patron use of .tiie system overlpad^ the refer^ 

v^^ ^ i ' ^ \ ■ \ ■ ' ■ 

ence staff. ^ i - 

m Publicity plan J Stage! (distribution of bookmarks ^ posters, and brochures), 
and Stage 2 (promotional mailings to local business) carried but. Many npws.;^^ 
paper stories appear in local press, ^ 

i 

Decembor 1974 - March 1975 (Third Quarterly lieport) - 

m Intensive preparation for the foe portion of tJie stady. Participating' libraries 
decide that restricted budget mal<es It imi^osslble to budget any library funds 
. for. project, and that all such costs will be passed on to the patron ^ Members 
of Oversight Committee exiDress disappointment that not even token funds ore 
forthcoming from libraries* 

• Because of tlie high level of search activity ^ participating libraries request 
flnrmelal support for soar oh perBonneL NSF approves a $10 per terminal hour 
subsidy for tills pui'posQ (domonstrrition time is not Included). 
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m ^'Standard seaj-ch*^ proposed by Lockheed because of concern expressed by 
- librarians concerning cost of seoxch to patron. 

m Crlsli at San Jose Public Library because of an overload condition created 
by San Jose State University students. A request was made from the library 
to the City Council that it be taiowed to withdraw" from the projept; request is 
denied because of use to community. San Jose Library School provides a 
graduate student to deal with overload^ and situation is resolved. 

m Legal form for fee period is developed by libraries, 

m Oversight Committee meets and discusses the San Jose situation, the need 
for development of a pricing policy^ and the need for more interpretation 
in the evaluation data. 

0 Publicity efforts are cut back because of high system use, 

June i975-Augast 1975 (Fourth Quarterly Report) 

ii taitlation of fee for service. No fee collection difficulties are experienced* 
m Number of searches drops to 10% of previous 
^ ACR completes aiialysiS of first year of free operation. 

e Cooper-DeWath time study to detormine distribution of ofiEline and online 

time is carried out for ACR* ^ ;^ 

# An additional day of training is provided to librarl [; ; ^ ^ 

m Project Is expanded to four nori-CIN libraries in other parts of tjie country 
using nonsubsidized search* . , ' 

September 1975 - December 1975 (Fifth Quarterly Report) . 

e Oversight Committee meets and rscommends tiiat two terminals be subsidij^.ed 
for a third year of EuU^cost search operation, as requested by CIN libraries* 
However I ttie Committee GKprossGS concern tiiat continued external ftmding 
will delay a full assessment of nonsubsidized online search In the public 
: library* . ■ - 

m Search activity increases from 115 last quarter to 187 searches this quarter 
(September, October, November), , ^ 

© Newspaper advertlsemonts produco littlo public reaponse. 

l-ll 
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a community having a iM'ge number of 



An Intensive mailing is sent to 
professionalBt 



Januarv - March 1976 (Sixth Quarterly Report) 

m The number of searches shows a sharp increase for this quarter , from a 

total of 187 in the previous quarter to 2S4, , 
m Dr. AWgren of ACR visits the hon^CIN libraries and reported on their 

chaxaoteristics. i ■ ^ , 

© The search volume for the unsuJbsidized libraries proved to be eKteemely low* 
9 The response to tiie mailing to a commimlty witii a large number of 

professionals proves to be quite low# 
>i A detailed review of searches is made by Ijockheed during this quarter to 

determine common search errors. 



June 1976 



m Oversight Committee meets to review draft of Two-- Year Report; recommends 
tliat tiiird year of the study be devoted to providing a. conceptual frajnework ' 
aiid to the evaluation of fuU^cost of onltnc search to pfftron. 



September 1976 

m National Science Foundation approves a time extension for a tiiird year of 
the study in accordajice witii the Oversight Committee reoommendatidns. 
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Section 2 

ONLINE REFERENCE RETRIEVAL 

This section provides some background on online reference retrieval, and indicateB 
the fee atoieture used in Uie DIALIB study* 

2V1-DIAL0G^ RETRliyAL SYSTEM 

The Lockheed DIALOG Information Retrieval Service was used in the study.. Over 
36 data bases In science and technology, business, social science, and psychology 
are available, as'shown in Fig, 2-t1, An annotated search, indicating the sequence 
of operations used, is given in Fig, 2-2, and the DIALOG system is described in i 
Appendix A, Although the DIALOG service was used, the results of the study should 
be applicable to any online search service that is accessible via telephone lines using 
standard terminals and offering a variety of data bases, 

To^perform a search, the user dials the telephone number of th^^search service and ^ 
obtains a high^-pltched tone indicating tliat the computer is available. The telephone 
handset is then inserted into tiie' acoustic coupler which is part of the terminal. A; 
message requesting tiie user password Is. printed out on the terminal. After tiie pass- 
word is accepted, tiie user specifies the desired, data base and then enters search ' / 
terms via tlie keyboard. Search terms cm be natiiral langtiage (English) or numerical 
codes (such as product, event, or concept class codes) for some of the data bases. 
The user is aided in selection of search terms by being able to have terms displayed 
that arc alphabetically close to an entered term. (For Womo data bases, terms that 
are conceptually close to an entered term can be displayed.) ^ The systent then indicates 
the number of document citations in the data basp^that contain the specifiecljtermjs),-^ 
and supplies an identificatlQn number for this set of citations. Sets can then be com- 
bined using the AND, OR, NOT opcratorsV' Bocauso of the command language used, 
and because Icnowlcdge of the data bases is reciulred, a search intermediary who has 
been 'trained to use the system usually perCorma the natual search , 

■ . 1 2-1 . ■ , i 

. ■ 1 ■ ■ I 
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LOCKHEED INFURMATION SYSTEMS 

DIALOG® INFORMATION RETRIEVAL SCRVICE 
WbrJdwide Access to ^ 

--OVER 12 MILLION CONTINUOUSLY AVAlLAiLifREFERENCES PROM WORLD'S PRINCIPAL DAlA 8AbL& 



SCIENCE ^ ) 

BIOS IS PREVIEV/S i%6B/hf) t Wsrldwidij eever^^ of fhe life 
ieieneii (1972 fo preienf). 

• CA CONDENSATES (|45/hf) -^Biblpogrephie date end keywordi 
For ch#mii?ry snd chemseflj gngmstrpng frem Chefnicpl Abitrgch 
Sefviee (CAS) (1972 fe present). 

CA SUBJECT INDEX ALIRT (S6QAr) - Subfeef indeij headings 
end CAS Registry Numbers for CAS doeurntnts (1973 te pfeient)J 

CA CHEMI^L NAME DICTIONARY (S60/hr) = CAS Rggiirry ■ 
Numbers, CA Indeji Names ^ snd rneleculqr fermylos for CASIA* 

• CAIN (|25/Hr}= Werldwide coverage of egricultufe frem thd 
Notisnel Agrieulfyral Library (1970 to presgnf). 

COMPREHENSIVt DISSERTATION ABSTRACTb (155/%)- Dae- 
te/el diisertQfiQni from qeeredittd univgrsitles (mestly U,S,) 
(1B61 te presgnt). 

SCIS-EARCH^-^ (S?0/hr)= Inrfeji to the |jteraf:«re sf scii^ce snd 
" technology from the IniMtute for Ssltntjfic Infarmotlon (t974-. 
■ 'te present). 



SOCIAL SCIENCES^ 

• AINVARM (|2S/Hr) = Abstriic(s ef Insrryetionol and Ro^eart" 
materials (1967 !□ pri?5cnt)* 

• ERIC (S35/hr) ^ CemplQte dato base of {jdycqtidnal mgtLrie.i from 
the idgcatlennl Resources Informutien Center (1966 r-'estnt), 

> 

• EKCiPTIONAL CHILD EDUCATION ABSTRACTS (SJ^/n'") - Litero- 
turi of educgfien of haridieopped and gifted childrer. (I^'^t, 'o 
present). 

LANGUAGE AND LANGUAGE BIHAVIOR ABSTRACT? 'Hj/hr) - 
Coverage of speeeh and longuage pathology (1965 ta piC^enA, 

• PSYCHOLOGICAL ABSTRACTS\(|50/hr) - LtreraryrG in p > ^I'ol'.nv 
and ethfir behqviernl sci^nees (1967 to presdnt)^ 

• SOCIAL SCISEARCm'*' (S70/hr) - Muitidiicipl fuir-, . < 
the sQeiol sclencei (1972 fo preient),. . - ^ ^ 

SOCIOLOGICAL ABSTRACTS {%h%fhi) - In-depth £over-.ot of 
sociology and related aregi (1963 to present). 



TlCHNO LOG^INql N EIRI NG 

'fcLAlMS'VCHEM ($lSO/hr) ^ U.S. chemleal ond ehemieoMy 
related patents plus some foreign equivalents (1950 te present), 

GiAIMS'^/GEM (|90/hr) -U.S. general ^ eleetrlcal, ahd 
meshgnicol patents (1975 to present), 

, • CQMPlNPEK {S65/hr) Werldwide eovorage of erigineering 
literature from Engineering IndeXj Ins. (1972 to present)^ 

■ INS PEC- PHYSICS ($45/hr) - Worldwide cayerage of physies from 
the Instityfien of Eleetrieal Engineers (lEE) (1969 to present). 

• INSPEC-ELEC/COMP ($4S/hr) - Eleetllcol engineering, computer 
scienge, and eontrsl engineering from HE (!?69 lo preient), 

ISMEC (S45/hr) =p Coveroge of meehoni^al engineering and engi- . 
naering management (197D present)* 

MEfAUEX (^BO/hr) Coyerage of metallyrgicei-ilteroiurG inelud^ 
in^. Metals Abitraeti Indes and Allays Indes (1966 to pfeient)* 

METEOROLOGICAL ABSTRACTS (SSO/hf) - Wnrldwlde meteoro- 
loglcnl pnd geoastrophy^slcol literoiyre (1972 to present), 

• NTIS ($35/hr) - CempUitR Government Repofti Anngyneemcnts 
dots bnse covering gsven^ment research from over 24Q agenciei 
{I9e*4 te presont). 

OClfANtC ABSrHACTS"''"($WHr) - Covefoge of worldwide ocean- 
ogreiphy^ Ohd marine -re loied litefoture (1964 to praseni)^ 

WORLD ALUMINUM ABSTRACTS (*5Q/hr) - Coverocie of techni- 
cal littfrqture ranging frgm ore precesslng te end yse (1968 to 
pre!>qht). 



BUSINESS/EC QNO.MICS . , . 

• ABI/INFORM (|6S/hr) - Coverage of buiiness, nnancej nnc* de- 
lated fields (1971 to preseni). 

CHEMIO^LJNDUSTRY NOTES ($90/hr) - Coveroge of the . ,^mH 
cqI proeess industries from' Predicast^j Inc. , and CA5 (1973 *>. 
present). 

FOUNDATION DIRECfORY ($Whr) - Dessriptlohi of ovdr bOO - 
foyndationi from the Foyndytlon', Center (maintained on cyrr?, • 
basis). '' . 

FOUNDATION GRANTS INDEX (|60/hr) - CymuloMon of gr 'r.?s 
rncsrdi from U^S. ^ihi lanthrep'rc feyndalisns (1970 to preset 

« PTS DOMESTIC STATISTICS (S90/hr)= Time series flnd'fsrec rn 
U.S. ecenomics, dpmggropjiic-Sj finance, ond produetion "(1^ : t^ 
present). 

• PTS ElS PLANTS (S90/hr) ^ Dytg and elasilficQtion of inqyitfiol 
plants In the U«St (mfilnldihed on cyrrent basis), 

• PTS F&S INDEXES ($9Q/hr) - Citatlens la artieles relevant tg busi- 
ness rgseorch (1972 to pfosent), 

• PTS INTERNATIONAL S TATISTlCS (^9Q/hr) - Time senei flnt^ 
fQp*?t;qs's oh foreign ecanomies, demogfaplilci j finance, end 
pfodueiien (1972 to present)* 

• PTS MARKET ABS TRACTS j|90/hr) Worldwide dtiveroge of CKem- 
ieol Market Abstrosts and Equipment Market Abstracts (1972 to 
present)* 

• PTS WEEKLY (T9D/hf) - Current ond extensive eoverrigii' of 
chemical and pquipmc^nf mnrkdl information; relofnd to Market 
Abstraeti Filr^(197? ta present). 



• Indicates data bases available at ineoptlon of Btudy^ June 10 



Fig. 2-1 DIALOG Data Bases 
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TM 

Performinc! a DIALOG Search 



"hl!^fni'" "rianoprous " and "deletiHous" are selected. Sets 2, 3, and 4, 
i?n^r€ velv f Finally the librarian combines the sets by ANDIng Set 1 with 
Jhelll fS^d by OR nq'seti 2.1! and 4. /The risultlng Set 5 has 7 citations 
relelani irihe lonce?t "harmful food additives." The library has rewstfd 
thaf these seven citations bt typed out at the tenninal and onesuch citation 
?s/5l5en be ow fhe tibrarlan wuld have requested that these citations be 
Jl i«; ,«H^m«11sd to the library. This Is often done when many 



printed offline and mailed to the library, 
c^^tatlons are to be ■printed. 

7 ) YOU HAY ACCESS THE FOLLOIJING FILES t 

I 1S-=ERIC THRU OCT. 10 "JAT • ASR • LIB/CA 

i -EhEM ABST VOL 13 -=INSPEC-PHYSICr 

M =-ERIG n?M a RD 13 "INSP^C-ELECT 7 

b -NTIS ntM-1^7M r IS -ABI DATA BASE 

7 ==SOC SCISEARCH lb "^"5'^"* y 

a — ENGR. INDEX 7S ^ 1? -CH* WEEKLY 

T —Altl 8 ARM ITO , la "pas 1T72 

ENTER NUHBER OF DESKED FILE - 
^ f ID - ' " ' , • 

f SELECT Food additives , / 

'l ai FOOD additp^es 
f SELECT HARflFUL / 

a laM HARrFUL I' 

f SELECT DANGEROUS „ , r 

3 12T DANGEROUS ' 
f SELECT DELETB?IOUS . ' ' 

M IM DELETERIOUS 

f COMBINE 1 AND <B OR 3 OR M> 

S 7 1 AND <a OR 3 OR H> 

f TYPE 5/5/1-7 

T5<S33.fia? FaN ID N0.-73-^3bM3flD □DlbSD 

FOOD POLLUTION-, THE VIOLATION OF OUR INNER ECOLOGY 
MARINE, GENE"-, VAN ALLEN, JUDITH n i^-jS 

NEU YORK, HOLT, RINEHART AND UINSTON 3aS P. ITO ' 
BESCRIPTORS- ADDITIVES AND ADULT^ANTS, F001>-RELATED DISORDERS, 
FOOD STANDARDS AND LEGISLATION, PESTICIDE Rf fe^^?;I'!LTT^v?s' 
FOOD AND DRUG ADMINISTRATION, CANCER, FOOD FADS, FOOD ADDITIVES 



rig. 2-2 .Typical DIALOG Search 
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2.2 SEARCH FEES V . ' • 

As indicated previously ^ the pai'ticipating libraries chose to pass the cost of aearchliig 
on to the patron during the second year pay period. We will not discuss the pros and 
cons of fee for service in the public library; tiie Interested reader is referred to Ref . 2 
and to AppendLx E of Annex 1. For an analysis of the cost of online searphing, sea 
Appendix F of Annex 1 . 

2.2.1 Fee Structure 

There is no fixed montiily cost associated \vitii subscribing to the DIALOG system. 
Instead, sQ^ch cost is computed on the basis of '^connect tlmej the actaial clock 
time that tlie user is connected to tlie system. This conneet tlnie cost varies from data 
base to data basej as was indicate in Fig* 1-2. : 

Because they were concerned about tiie cost of search to tlie patron, tiie participating 
librarians requested that an alternative fee structure be provided for the eKperiment - 
a structure tiiat did not depend on connect time. Therefore , two different fee structures 
were ottered to the participants, a "custom search" that had no limitations ^ and which 
was based on one-half the usual connect time costs, and a special "standard search V 
at a flat fee of $5 per search that was limited a single d^ata base and to 20 offline 
prints. Figure 2=3 shows a llyer that e?qDlaln^ tiiese two types of Beardh to tlie public. 

Contrary to our eKpectations, the standard searc^h was used only a small fraction of 
Uie time. Two possible factors that led to this light use were (1) tiie ability of 
performing a custom search In the low cost data oases such as ERIC at less than. $5, 
and (2) tlie restriction to a single data base was found to be too confining, . 

. . I ' ' 

2.2.2 Mechanics of Fee Collection 

Fears were caressed that tKe libraries would encountor much difficulty in fee 
collection, both because of refusal of a patron to pay the bidaiice of the lee duo to 
dissatisfaction with the results, as well as by patrons who fall to pick up their results 
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COHPUTERIZO INF(«riATION RETRIEVAL 

¥„r your convenience, the fonowing plans are available; 

1, Standard Search u * 

A search will be conducted In one data base. ' There Is « IJ^iJ oj 

basis, prior to setting up a cuctom saarch 

Cost: . $5.00 ^ 

2, Cu stom Search • . . 
"this search can ba as extensive as naceisary to fully examine the, 
materiui available on the subject. 

r ^ A nn/riPDOsU IS required for all custom searches, and the 
balance U £^'^1^1^ of the search, or at the t1n« the off= 
line prints are picked up* = . / 



This system will conipile a sizable 
bibliography for. you if the subject 
is currently of great Interest or 
if 1t has been heavily researched. 

JUST RIGHJ 

Too much 



If ^our particular subject is 
rare or unexpipred, the computer 
may seek in vain. Perhips it 
will not can up a single citation* 
' . Not enough 





Se& sample, on Qtho/i sM^, . ■ • 

Brouqht to you by; Cooperative Information Netwonk . 
Lnckheed InfLation Systems and the National Science Foundation 



Fig 2-^3 Flyer Ejqplalning Fee Se^^oh to Patron 
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their results md to pny the balance due. For this reason, a contract-lilce form was 
prepared and used, as shown in Fig. 2-4,* In iiddition, a procedure was eatablishcd 
so that a disgruntled patron could obtain a refund if the search was forwarded to 
Locldieed for aiialysis, and it was found that the search had indeed been incorrectly 
performed, (The llbrnry would refund the money to the patron and Lockheed would 
credit the library *s account for that amount,) 

Bi actuality, there were no requests for refunds and no defaults by the patron. It 
surprised the librarians to have some of the pati^ons indicate that they thought thai 
the search would cost even more, (See AppendLx B for some librarian comments 
concerning fees aiid the collection.) None^ of the libraxies us^l bank credit card 
operation J but several established accounts for several repeat users. 

2.3 IMPACT OF, FEE ON SEARCH VOLUME - . 

The impact of fee for service on seai^ch volume is shosvn in Fi^* * 2-^5. Note tiiat the 
search volume rose during ttie free period from 55 searches in September 1975 to 
approximately 300 in^ May 1975, for the four GIN libraries. In June 1975, when fee 
service was initiated, the search volume dropped precipitously to 29 setu^ches, 
at rose during tlie year until 77 searches were perform^ in May 1976. 



*The procedures used in fee collection at the San Jose Public .Library are detailed 
in Appendix F , / ' . . 

/ 

/ 
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SAN JOSE PUBLIC LIBRARY 
DIALOG SEARCH AGREEMENT 



OIALOG makas It posslbie ta search a largs nwnbar of documents, periodical 
^ticlQa* and regeareh reports and compile a bibliopaphy on a conciaa subjact, 
DIALOG is not deaignad to provida answers to specif lc questions. The raauits 
of= a search largely dependent on the sonGiSengss of the deftnitisn of 

aubjact matter desired and the ksyworda or phraaaa chosen by the patron to 
describe it* 



Two types of DIALOG s^ai^chei are availablai 

STAHDARD SEARCH 

Coati SS-00 prepaid. 



Conditions \ 



CUSTQK SEAHCH 
Cost I 



Condi tiona : 



Seardi will be conducted in one data base. 

A limit of ten sets can ba formed, 

A limit of twenty citatlong can be printed on-lina. 

Additional off^'linQ citations can be printed at 

five cents pier citation. 



$5*00 deposit must be paid on all custom gearches. 
The balance is payable on compLetion of the Gearch 
or at the time the off-lina prints are picked up* 
The charge will be fifty percent of DIALOG'S 
canmercial rata 

Search can b^ eKtensiva as nsGessary to fully search 
the subject* 



I have conferred with a librarian and discussed SBarch teri^ and strategy. I 
understand that a cost will be incirrad whathor the search is successful or 
not and agree to compensate the Library' for such costs, I have read the 
"DIALOG Search Ap^eoment'' and requast that the San uose Public Library perfoviu 
a search. 



Date : 



Signatiffe 



AHOUNT 



DATE 



Standard Seareh 

Off-line Print a t 

Custom On^Line Cost 
Cuatom Search Total 
Custom Search Dspoait 
Staff and Connect Time 
Balance 



Search Number _ 



Librarian 



(Please mnke chick , payable to the San Jos© Public Library) 

Fig. 2=-4 Typical Fee for Saarch AgTeemeiit 
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Soction 3 
EVALUATION SUMMARY 

One of the principal purposes of the evaluation condudted by Applied Commuiiication 
RoSGarch was to provide public library administrator sHvitli data which would allow 
them to make decisions about the utility of providing an online search service through 
tile public library and to determine what the cost bf such a service would be,^ To 
accomplish tliis purpose, case studies covering the a^-yeaj: period of the exiDeriment 
were completed for each of the four Project DIALIB libraries* 

These case studies actually cover two different approaches, by each of four libraries, 
to the provision of online search services. In effect, then., the evaluation is based 
on eight case studies. These studies look at the effects of goffering online serviceB 
to patrons iirst at no cost (referr^ to as the **free period and subsequently at 
half-cost (referred to as the ''pay period *0 through each of the Project DIALIB 
libraries. (Evaluation of a fiiU-p^ period is now in progress.) to addition, the 
evaluatidn compares differences In online system operation between each of tiie four 
Project DIALIB libraries for both time periods. 

Data for the case smdies were collected through four major inetruments; computer 
command summary sheets; se^^ch request forms completed by both the patron at 
the time of the seEurch request and by the librarian upon completion of the search; 
follow-up questionnaires completed by patrons after receipt of the results of tiie 
search; and interviews with working librarians, head reference librarians, and 
library administrators. \ 

The evaluation was aimed along tliree major dimensions^ descriptive analysis of 
actual searches; analysis of usage patterns and user characteristics; and analysis 
of library impact. Seai^ch statistics included Information on search costs, staff 
time devoted to online searching, location of source documents, and time to complete 

■ 2\ : 
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the seai'ch. Usage patterns and user uhai'actoristics included information on user 
occupations, reasons for seajchs level of education, type of question, value of 
search to patron, nuniber of usefid citations,, ajid source through which patron heard 
about the availability of the online service. Librai^y impact analysis included an 
assessment of the impact of aii online service on the reference service, the reference 
librarian, library policy, and the community served by the library* Changes which, 
occurred within each evaluation dimension between the free and pay periods were ^ 
also identified and discussed* 

Bi addition, differences in online service operation and use between Project DIALIB 
libraries were identified and discussed, ' During both the free period and tiie pay period^ 
libraries differed in number of searches conducted, average search time, and 
average number of online and offline citations prints. Interlibrary differences were 
also noted in patron occupation, reason for search, the method through which the 
patron heard about the avallability'of the service, the value of the search to tlie 
patron, and patron responses t^ a question asking if the results of the search provided 
sufficient references to ansjyer tlieir question adequately* There were also noticeable 
variations between libraries in terms of client availability at tlie time of tlie search 
and in the time which elapsed between submission of the search request by the patron 
and subsequent receipt of the search results. 'To assist in es^plainlng some of these 
observed differences, profiles of each library were compiled, based on interviews 
with reference librarians* - * 

For a complete discussion of interlibrary differences, the reader is referred to 
Chapter IV, Aimex 1^ of the Interim Eeport. Reasons for differences, which are 
highly speculative, are not summarized in this sections , 

The following evaluation material only highlights some of the data collected during 

the cour'se of ti^e evaluation* For complete Information on all aspects of the evafuation, 

the reader is referr^ to Annex 1 of liie Interim Report. 
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3.1 SEARCH STATISTICS ' . ! - - - - - 

i 

© How many seai^chcs wore performed ? 

A total of 1920 soMches were completed by the four libraries during the fi*ee period. 
As expected j the number of search requests dropped precipitously in June 1975 
when charges were Introduced. However, tiie total number of searches being con^ 
ducted each month during the pay period Increased from a low of 19 in June, 1975 to a 
high of 103 by March, 1976- and dropped back to '69 in May, 1976. By the end of the 
pay period, a total of 747 searches had been completed. 

e Wliat was tlie average search time? 

Searches conducted during the free period required an average of 22 minutes per 
search. However, average se^ch times decreased steadily over the/J^month free 
period, dropping from a Mgh of 31,28 minutes in September 1974 to 18,69 minutes 
in May 1975. The average search time for custom searches completed during the 
pay period dropped to 15.90 minutes. 

m How many citations were located ? 

During tiie free period, an average of 14.27 online citations and 55,83 offline citations 
were printed per search. During tlie pay period, the average number of online citations 
printed per search dropped to 3.42 while tlie average number of offline citations 
printed per search increased to 88,89. 

@ Wiiat were the most popular data bases ? ' ' ^ 

The five most frequency used data bases during both the free and pay periods were 
EMCp .NTIS, Psychological Abstracts, Social. Science Citations, and Engineering md ex, 

& How much offline staff time is required per search? 

Offline preparation time (per search) varied widely both between time periods and 
betsveen libraries, Llbrariajis estimated that they spent mere time offline preparing 
for a search during the pay period tilian they did during the free period, Jxi fact, 
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during the froe period, 45,7% of all soarchbs involvcd no offline preparation time as 
opposed to 19,3% of all scarchea conduated during the pay period. The porcontago 
of searches requiring from 15 to 25 minutes of offline time nearly doubled (17.3% 
to 33,6%) during the pay period. The percentage of searches requiring from 30 to 
35 minutes of offline time nearly tripled (5.0% to 14.3%) during the pay period. 

@ \Vliat is the averago eost of an onlme search? 

The average sea3.^ch conducted during the free period cost from $14,80 to $24, 10, , not 
iiicluding staff time or fixed e.^enses* A detailed time/eost st\idy of online scai^ching 
was completed during the free period (see AppondLx F, Aimex 1)* The results of 
this study indicate that the average cost of a search completed during the free period 
was $28*41. This cost includes online and offline staff time, online search time, 
and oEfline citations printed (telephone line charges are not included). About; 20% , 
of tliis total cost is staJEf time. The total cost of the average custom search bompletod 
during the pay period ranged from $9,33 to $20. 56 (patrons paid one-half of these 
costs). In fact, the cost to tlie patron was less than $10.00 for 61% of all searches 
completed during tlio pay period. (Notet During tlie pay period, pati^ons were 
charged one-half the cost of online search time plus offline clations printed.) 

m How lonp: did it take to receive search results ? 

During the free period, 50% of online service patrons received the results of their 
searches in 1 week or less (from the time the search request was submitted). About 
79% of online service patrons received the results of their searches in 1 week or less ; 
during the pay period. Although there were differences between libraries in turnaround 
timq, generally the time which elapsed before the patron; received ^results was r^educed 
at all libraries during the pay period. — " - 

m What Sources Are Used to Obtain Documents ? 

Patrons used a wide variety of sources to obtain documents cited in search results. 
College libraries were the major source; 33% of search patrons during the free 
period and about 46% of patrons during the pay period obtained one or more documents 
from college libraries. About 30% of patrons during the free period and 22% of 
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patrons during the pay period obtained some documents from the library at which 
the search was conducted. Various other sources, Including publishers, NTIS, 

company libraries; and departmental libirarles of the State of California also prcArided 

t- ' 

patrons with documents. 

3.2 USAGE PATTERNS AND USER CHARACTERISTICS 
® Who ai^e the -users ? 

The principal user groups are graduate students,^ educators (including teachers, 
professors and school administrators), technical professionals (including civil, 
nuclear, and electronic engineers, geologists, and computer specialists) ^ and librar- 
ians. These four groups accounted for 48?o of all users during the free period and for 
about 56?o of all users, during the pay period* The most notable change between the 
free md pay periods occurred in the college (imder graduate) student category. Use 
by college students dropped from about 1B% during the free period to about 9% during 
the pay period. ^ About 68% of all search patrons during the free period and 57% of all 
patrons during the pay period had\completed some graduate work or held advanced 
degrees (M/s:, M.B. A., Ph.D., etc.)* - 

m How do patrons hear about the availability of the service ? 

The major publicity sources during botti the free a'nd pay periods were librarians 
and friends. During the pay period, professors replaced library notices and newspaper 
sources as the third most frequently cited source and library notices replaced news- 
paper sources as the fourth most frequently cited'source. ■ 

m Why did users request an online search ? , 

Most online searches were requested as either part of the patron^s Job or for research 
papers. About 33% of all searches, during the free and pay periods, were requested 
as part of tiie patron^s job. About 33% of all searcfies complete during the free 
period and about 43% during the pay period were done for research papers. 
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m What were the searnh topic arGas ? 

The types of questions asked by users were highly complex dealing with a wide variety 
of subjects, including psyehology, education, engineering/science, biology/medicine, 
social services, and, agriculture, A comparifon of online search questions and typical 
small public library reference questions indicates that online search questions are far 
more tecliniaal and complex than the t^es of questions normally asked of a reference 
librarian in a small public^ library. 

m. Did patrons find the search worthwhile ? 

During the free period, 53% of online service patrons stated Uiat the results of their 
search provided sufficient references to answer their question adequately. During 
the pay period , tiiis percentage increased to almost 60%, The number of citations 
actually of use to the patron also increased during the pay period. Only about 13% 
of patrons^during tiie pay period indicate tliat no useful citations were received 5* as 
opposed to almost 18% of patrons during the free period. Also, nearly 21% of patrons 
during tlie pay period indicated tiiat from 21 to 50 citations were of use to them (an 
increase of almost 11% over the free period). The largest percentage of patrons 
(about 30% for both the free and pay periods) indicated that from 1 to 5 citations were 
actually of use to them. About 70% of patrons during both periods indicated that the 
results of their search were of much value* ^ 

m Are users regular public library patrons ? 

Approxtmately 90% of search patrons hold cards at one of the 150 libraries in tlie 
Cooperative Information Network, However, only 36?o ot online service patrons 
during the free period and only 30%'of patrons during tiie pay period hold cards at 
one of the four libraries conducting searches. About 60% of online service patrons 
Indicated that they normally used the reference service at a public library only 
several times a year or infrequently. Only 7% of online service patrons use the rrfer- 
ence service on a daily or weekly basis , 

*lt should be noted that for some types of search, e.g, , patents, Ph.D, dissertation 
proposals, etc., no useful citations is a positive result, 
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® Will p atrons use the sorvlco In tho futiirG ? 

During tlie free period, about 26% of patrons indipated they would use an onlin- iiierviau 
at least monthly. Anothuv 67% indioated that such a service would be useful several 
times a year. Durmg the pay period, about 80% of online service patrons Indicciited 
that the iservice would be useJ:ul to them several times a year* Approximately 10% 
indicated that the service would be useful either niontlily or more often, half of the 
users stated that the results of their search suggested additional questions of interest 
to them. 

3,3 LIBRARY IMPACT 

The introduction of computerized search services has had litlle overall impact on the 
libraxies participating in the experiment (at least, not within the 2-year study peridd). 
Provision of the online service did, however, have a substantial impact on roferencc 
service staff responsible for conducting searches* The entire search process 
including query negotiation with tlie patron ^ offline preparation time, online search 
time, relaying search results to the patron, location of source documents, and billing 
(during tlie pay period) required substaiitial amounts of staff time. In addition^ indi- 
vidual staff members spent a great deal of time, initially, learning system oporation 
and data-base organization. DIALOG operators continue to spend time maintainiiig 
and improving their online expertise and learning new data bases. Each of these 
factors Is discussed more fully In the fQllowing section. The effect of the online 
service on library policy and ajdministration generally was less noticeable at this 
point in the project. 

3*3*1 Impact on Reference Service • 

The major impact of the new service vvas the increased work load and the accompanying 
stress Imposed on the reference staif . No extra staffing (with one minor exception) 
was provided for the project at any of the libraries. There are a number of factors 
which have oontributpd to the high demand on staff time: 

e By the end of the free period, the libraries were averaging about 90 searches 
per month, requiring from 20 to 30 minutes per search of online time. In 
addition, about 44% of all searches completed during the free period required 

3-7 ' 

37 

LOCKHEED PALO ALTO RESEARCH LABORATORY 

I O C K H i i D M J I 1 I I i I 1 i F A' C i COMPANY, I N.C 



LMSC-D502595 



from 5 to 25 minutes of offline preparation time and another 10% required 
from. 30 to 90 miimtos,* By the end of the pay period^ libi\iries wore 
averaging about 24 searches per month, requiring from 16 to 18 minutes 
per seai'ch of online timep For all searches completed during the pay 
period, about 50% required from 5 to 25 minutes of offline preparktion time 



and about 30% required from 30 to 90 minutes of offline preparation time, 

Q ICach suiu^ch also required fairly extensive interaction between the librarian 
and tlie patron. Seai^ch request negotiations frequently involved "iengthy 
explaiiations of the search prooess by the llbrariaii. * 

m The locotion of source documents upon completion of the search is anotlier, 
and usual, potential demand on staff time* In the case of Project DLALIB, 
this has not proved to be a major difficulty, 

# Staff were also t^esponsible for calculating search costs during the pay period 
However, the. introduction of onlme printout of search costs (which Lockheed 
has now implemented) should eliniinate this accounting task* 

m The introduction of computerized search sei^vlees has also Increased 
patronage of tlie reference service at the libraries participating in the 
experiment (see the section oh Search Statistics), However, most of these 
patrons are from outside the normal -^service area*^ of the libraines pro^ 
vlding DIALOG searches. In addition j librarians feel that most of these 
new patrons come Into the public library only to use the online service, 

m The heavy demand for .demonstrations of the service has also requited a 
great deal of staff time, i 

3,3;2 Impact on Referenee Librarian 

The online search service has also had an effeet on individual librarians who conduct 
searehes* \ 



*This is typical of manual indcpth referohce work. 
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© Individual Ubravians are rGsponsible for negotiating search requests ^ for 
conducting seardshes, and for maintaining a oortain level of familiarity with 
the actiial operation of tlie system, 

m Librarians are responsible for learning the orgojiization and content of now 
data bases added to the system mid for mointalning proficiency in searching 
data bases; just as is necossary vvith hard copy reference tools* Most 
staff felt that the diversity and range of subjects covered in online search ^ 
requests posted a problem unique to the reference staff of small public 
libraries. Reference librarians need to be skilled in searching some 30 
to 40 data bases to handle such subject diversity (although library service 
policies could restrict searches toHi limited number of bases)* 

m Reference librarians have mdieated that the use of computerized search 
serviceB gives tiiern a new feeling of competonee in dealing with tochirical ^ 
reference questions that they would have been unable to answer without the 
service. They have also indieated that use of tiie system has been a highly 
educational experience. - 

^ 3, 3, 3 Impact on Library Policy 

The third major Impact on the library depends on tlie policy the library adopts to 
cover the cost of the service* Project DIALIB libraries have chosen, during the pay 
period, to pass half the cost of online search time plus the cost of printing offline 
cita^tions on to the patron.*^ However, a number of alternatives are available. 

m If a library decides to include the cost In Uieir current budget ajid continues 
to provide free searches, tills could have some effect on library policy, 
\ Administrators should keep in mind that provision of a free online service ■ 
cuts into ttie funds a;nd staff time available for the establishment md/ov 
ODeration of oHiei services. The heavy demand for free ssMahes would 
certainly necessitate either the hiring of additional staff tp= conduct computer 
searchos or the establishment of a policy that would limit system use 
according to some criterion determined by the admlhistration* 

*The NSF ffrant pays for the other half. 
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© Sliould a libravy decide to pass aoma portion or all of the cost of the service 
on to tlie patron, tliero could bu some impact duo to the nuod for a structure 
capable of dealing; with billing and foe collection. The ''cash ajid carry" 
policy adopted by the libraries during the pay period seems to have had 
little effect on general librai-y operations. The main impact cf the policy 
was to iiicrease the time domajidB on reference staff, as nertain staff 
members were responsible for calculating\ search costs, 

B Provision of fee--for'-serviee eomputer searches may also require some 

rather important policy decisions. For instance, Uie library must determine 
if all patrons will be charged uniformly for tJie service or if patrons will 
be charged on a scale based on ability to pay. (Most public librarians seem 
to feel that the second alternative is not feasible for a public library,) If... , 
\ the library decides that the user should pay for the service, it must also 
decide if the patron should only pay for the cost of connect time U) the data 
baseSsUsed in the search and for the cost of citations printed offline , or if 
an additional f^c. ahould be chai^ged to cover staff time, communication, and 
eciuipment co^tB . ' ' - . 

3.3 A Impact on the Community 

Although online sein^ice has attracted patrons to the public^ library reference service, 
most of these patrons ai^e from outside tiie community in which the search library is 
located (36% had cards at the library at which the search was performed, 54% had 
cards elsewhere, and 10% did not have a librai^ card). 

Still, on a small scale, online service patrons have. been introduced to new services 
ajid have expressed greater awareness and appreciation of new information technology 
and of the iiuiovatlveness of the public librai^y* Once patrons utilize the service, they 
are quick to suggest a wide variety of additional data bases that they wmld like to see 
made available through the computer, ■ 
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Online search services do have the potential of providing reference support services 
to mimicipal governmont* However, this potential has not been realized during^Uie 
2 years of Project DLA.yB. During tiie first year of the project, the clly manager of 
Redwood Citj^ stated (for the first time) tiiat,one of the services syUch the public . 
Ilbrai^>- could provide was ''back-^up research for local government officials J* And, 
in fact,- Bome municipal agencies did pose a number of technical questions to Project - 
'felALIB librarians on subjects such as helicopter noise livelSj redevelopment fin^cing^ 
patrol car maintenance J open cliannel flow of storm waters, and solar energy. However 
the full potential certainly has not been realized as of the end of the second year of, 
Projcpt DIALIB, Project DIALIB librarians at three libraries* were disappointed 
and discQuraged about tlie lack of response from both municipal agencies and municipal 
government officials to the availability of the service. Several of tiie libraries made 
special efforts to provide municipal agencies with demonstrations of tiie online service. 
The Siuita Clara County Library, In addition to demonstrations, provided a fixed sum 
of money to cover searches requested by municipal agencies, but municipal agencies 
made little use of the service. 

Thus, provision of an onlme service has had very little impact on the communities 
BQWcd by the participating libraries, at least not on a short-term basis. The 
IDOtential for a substantial impact remains, particularly if some of the additional 
data ba^us requested are made available. However, as in tiio Introduction of almost 
all innovations, any observable impact will probably be accomplished only after a longs 
* puiiistaJdng process involving education of both the .public librarian arid tiie public* 



,+The San Jose library found a growing use of the municipal reference servico. 
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Section 4 
CONCLUSIONS 

One of the prmQipal purposes of the evaliiation conducted by Applied Communication 
Research, as stated in Section 1, was to provide public library administrators with 
data which would allow them to make decisions about the utility of providing an online 
.search service tiirough the public library and to determine what the cost of such a 
service would be. The data in Section 3 were thus presented with the objectives of 
providing administrators witti.tiie kind of information that would be useful in planning 
for an online service under two different funding situations... No attempt will be made 
to summainze such specific data on users, usage patterns, and search costs in this- 
- section - 

Insteaa, this section contains general conclusions suggested by the evaluation data 
and a number of pertinent observations derived from tlie entire Project DTALIB 
experience. It should be noted that most of the following points are subjective 
judgments based on a.dombination of observation, ^^ard^* data, and extensive inter- 
views wiUi pi^oject participants. Apparent causal relationships cannot be verified 
using data obtained in a highly uncontrolled, case-study approach. Although most 
observations cannot be verified, they are still Important both as indicators of factors 
which may affect tlie success or failure of an online search service offered withm 
a public library' context and as indicators for futTiro research. 

It also should be .noted that the impact of online search on a public library familiar 
with the rcquiromants of indepth refercnue search will bo dlfforQnt than on a small 
public library having minlmrd roforence capabilities. We have tried to make this 
distinction clear in these conclusions, \ 
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(1) The public library can be an effective channel through which to provide an online 
service. (Which is not to say that public libraries arc the most effective channel — 
the data cannot support such speculation.) Project DIALIB libraries averaged 

90 searches per month during the free period and 24 searches per month during 
the pay period. Also, about 70% of online service patrons during both periods 
felt that the results of their search \yere of much v^ue* 

(2) Riblic libaries are not all equally well suited to provide online search services. 
At this time, online services are useful mainly to patrons needing information 
indepth. The principal users are primarily educationally sophisticated profes^ 
sionals. Thus, areas with a Mgh concentration of mdividuals falling into the 
principal user categories provide the best *^markets" for online services. Public 
libraries serving such areas would certainly/find more demand for an online ser- . 
vice than would public libraries located in ateas with a low percentage of "Infor- 
mation literates." The most effective service (in terms of high volume and rapid 
turnover) seems to be provided through those main libraries that are easUy 
accessible and that have a high potential for direct contact (either by phone or 
through "walk«in" trade) with patrons requesting online searches. In coritrastp a 
library which is not easily accessible, which has little direct contact with patrons, 
and wliich would probably receive the majority of online search requests via branch 
libraries, would probably be less effective. 

(3) A public library interested in operating an online service should be aware of exist- 
ing services which may be available to the public. If adequate services already . 
exist to supply the information needs of user groups, the public library may not 
wish to enter into "competition" with such services, 

\ 

(4) If an online Servia n Is readily available at the public library,, a market does exist 
for the service, - data indloato that online system patrons are not fpquent 
users for the public library rcferonco soi^vice* Instead, they are highly educated 
professionals and students from a number of vuriccl disciplinoB who do not nor- 
niuily consider the roforence service at a small public, library a source of indepth 
Information. The majority of ciuoatlons asked by these online service patrons arc 
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highly teciinical and complex/ Reforence librariaiis at the putalic libraries par- 
ticipating in Project DIALIB indicated that thoy wpuld not be able to answer such 
questions without the assistance of ah online service. . . 

(5) The initial provision of free searches to patrons, along with an active publicity 
campaign, seems to have had a strong impact on search volume. The four Project 
DIALIB libraries complfeted nearly 1,000 free searches during the first 6 months 
of operation. In contrast, libraries providing full-cost service to patrons (see 
Appendix D of Annex 1) witiiout an Initial free period or attendmt publicity cam- 
paign Indicate a relatively low volume of search requests. The available data do 
not allow a determination of the relative importance of these variables (free search 
period, publicity campaipi) either individually or in combination, 

(6) The allocation of reference iervice staff time is one of the most important factors 
to be considered in planning m online search service. As indicated earlier, 
public librarians in small public libraries do not normally perform indepth refer- 
ence searching on the types of teehnicai questions submitted by online service 
patrons. Computer searclilng on such questions and related tasks are too time 
consuming to be simply added on to such a public librarian's reference duties. If 
such a service is added without proper provision for staff time, other reforence 
duties and/or services may suffer from neglect. In addition, Inadequate staff time 
for an online service adversoly affects search volume and turnaround time. Over- 
worked staff are also more likely to be hostile toward the introduction and subse- 
quent operation of a now soi*vico. 

(7) To maintain search proficiency, online searchers must complete some "uritical 
mass'' of searches each month in each data base for which proficiency is desired, 
(It is not possible to determine optimal upper and lower limits on this critical 
mass from the available data. ) Project DIALIB searchers who aompleted relative- 
ly few searches in one month felt less competent at online searching thm did more 
prolific searchers. They felt that "hands-on" eKperlence was required to maintain 
familiarity with data base orgimi^ation, optimal search strategics, and data base 
content. On the utlior hand, a librarian ovorloncled with an oxorbltunt nunibur of 
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searches in 1 month may find that time limitations imposed at all stages of the . 
search process (includtag query negotiation, online saarcH time, and relaying pf 
citations to the patron) may 'toect saarch quality. 

(8) The problem of maintaining familiarity with all data bases Is one of the most 
difflciUt problems faced by referenea librarians conducting online searchas. ' 
Project D^LIB librarians ^ who assumed responsibility for conducting searches \ 
in all data bades, felt generally tiiat tiieir search competence Increased with data \ 
base familiarl^* The proliferation of data bases makes It extremely difficult for 
one person to maintain a thorough taiowledge of each new data base* Project 
DIALIB librarians felt that ^ like^ the ha(^^^^ ba^es— ^ ^ 
have a relatively unique organization and content , and that significantly compounds 
the problem. There are tvvo possible approaches whlfth may help to ^levlate this 
problem. An org^izational ap; coach jvvould be to make each reference librarian 
responsible for maintaining es^ertise on a limited number of data bases rather 
tJian trying to cope with all of them. Project DIALIB librarians did not use this 
approach because reference^ librarians work in shifts (an "expert" in a particular 
data bas^ might not be on duty when needed for a particular search), and particular 
"e^erts*^ woulTbe unavailable while on vacation, A training approach would be to 
develop batter instructional materials describing the organization, content, rele- 
vant keywords, and optimal search strate^es for each data base* The absence of 
such instructional materials was one of the most persistent complaints ej^ressed 
by Project DIALIB librarians. 

(9) The aniount and quality of general training in online system operation may also 
affect the successful operation of the service. Most searchers believed that the . 
initial training sessions alone were not sufficient for optimal system utilisation. 
They felt that either additionai training sessions were required after soarchers 
gained CamUiarity witli system operation or that training manuals should be made 
available to assist searchers as they gain oqjortise. Almost all staff felt that 
better soarchcr--oriented instructional materials for DIALOG should bo developed, 
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(10) The attitude of the head reference librariM toward the service Beems to have 
had a substantial Impaot on the speed ^d efficiency with which searches were 
completed. Librarians at all libraries found that provision of an online search 
service imposed additional demmds on their time. However, at .those libraries 
at which head reference librarians had a strong positive attitude toward the . • 
service-j more searches were completed md were done in less time than at 
libraries where this attitiide was missihg^^ 

(11) Tfrb^major effect of tiie shift from a free to a fee-based jervle^as^^redutftio^ 
in tiie voljime^QfLseaEch-Mquestsr: however , a steady 

"""increase in search volume during the pay peridd. ) Some shift was also obierved 
in the allocation of staff time to various steps in the search process. During the 
pay period, staff attempted to reduce connect time (and subsequently the cost of 
the search to the patron) by spending more time offline preparing for the search. 

(12) Flnallyl the provision of an online search service has done little in the short-term 
to alter the image of the public library in the community it serves. The principal 
impact ^f the service has been on professionals in both business and industry and ' 
on college students, all of whom have been particularly impressed by this new 
service being offered through the public library. These users seem to view tl>e 
public library as being more innovative and progressive than they had cdnsldered 
it to be prior to the implementation of the online service. Most municipal govern- 
ment officials have talcen only cursory notice of the public libraries providing on= 
line search services;. In spite of considerable effort on the part of DIALIB 
librarians to provide government agencies with demonstrations and/ or free 
searches (even during the pay period), a few such agencies actually made use of 
the service. However, government agencies In San Jose did make use of the ser- 
vice and at least one government official did note that a public library might be 
capable of providing support reference sei-vices for governnient agencies. 

* * ♦ ' 

The process of changing an image or Increasing public awareness of the rolo or 
function of the public library Is a long, slow process. It is certainly much too 
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soon 'to suggest what the long-range impact of aii online service might be on 
eithei the public library or the'oonimunlty* In particular , one of the key questions 
remains unanswered: Can online search sustain itself in the publioj library after 
all subsidies have ended? The final report to be produced in the.Fall ofr 1977 will 
b© of particular interest, since it will covjer- n^^ only the June 1976| ^ May 1977 ^ 
period in which the only subsidy was the terminal rental, but wiU also indicate 
what happens when the terminal subsidy is removed. 
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DIALOG INTERACTIVE INFORMATION 
RETRIEVAL SYSTEM 

DIALOG is the name given to an interactive, computer-based intormatlon re- 
trieval language developed at the Lockheed Palo Alto Research Laboratory, The 
DIALOG system consists of a series of computer programs which have been de- 
signed to make full use of direct access memory devices (in which data located 
anywhere on the device can be accessed in approximately the same amount of 
time) and video display units to provide the user a rapid and powerful means of 
identifying records within a file which satisfy a particular information need. By 
providing the user full display access to the indexing vocabulary, and the ability to 
modify search expressions, DIAXOG becomes a data processing extension of the 
human, operator who directs and controls the process according to his own personal 
needs. Figure 1 shows a DIALOG communications terminal which enables the user 
to communicate with the computer. The user issues commands to the computer by 
way of the keyboard, and he receives results on the display unit and/or on the 
teletype as appropriate. DIALOG allows the user svith a yell-defined search topic to 
proceed directly to desired records: the user who cannot so explicitly define his 
requirement is provided tools for browsing through the file. It is thus possible to 
investigate successive avenues of interest as they arise jor are suggested by Inter- 
mediate retrieval results, ■ 

. The language procedures are easily learned, and the system has been used 




FIOURE \^ DIALOG commimkailom tennbwl 
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successfully by educators^ working scientists, engineers, and librarians. To under-' 
stand how such an information retrieval system, operates, one should be aware of 
historical solutions to the problem of information retrieval and should have a 
general grasp of the techniques employed within a computer to accomplish on-line 
retrieval of information. 

The central problem in information retrieval is to identify and obtain those docu- 
ments from a collection that contain desired information. The magnitude of the 
problem becomes apparent when it is rcalizedxthal many current^technical collec- 
tions requtr| several miles of shelf space for stori^ge. The user atlempling to identify 
all documents that might discuss welding defects aluminum or the use of molyb- 
denum disulfide as a solid lubricant in spacecraft,; for example, faces an almost 
insurmountable information retrieval problem. ^ 

The historical solution to this problem has been tq create an index to the informa- 
tion colleciioni Indexes can take many forms, Back-of-the-book indexes assist the 
reader in finding which pages of a book discuss a particular topic. Library card 
catalogs are indexes that enable the library user to find information through several 
access poinLs: subject, author, corporate source, report number, and other collective 
characteristics. Although useful, manual indexes are limited in severul ways; The 
more specific the indexing, the larger the index becomes, and the harder it is to find 
particular topics.of interest in the index. Consequently, manual indexes usually con- 
tain only relatively general subject headings which apply to large numbers of docu- 
ments, ^s a result, after finding a general topic of interest, the user still must scan 
a sometimes burdensome amount of material to identify specific items of interest. 
Another limitation inherent in manual indexes is the inability to combine or co- 
ordinate index elements into comprehensive groups. If one wishes to find what 
Stanford University has produced on the subject of teaching muthematics in the 
elementary grades, for example, the user has no way of combining the source entry 
point, Stanford University, s^ith the subject entry points of mathematics and ele^ 
mentiiry education. Furthermore,^ there may be several source entries for Stanford 
University, ' 

Computer-based information relrffeyal systems can largely' overcome many of the 
limitations of manuaLaystems if properly designed. In most cases computer-based 
relrievaLsystems not only allow the useKto combine several retrieval parameters, 
but they also provide relatively rapid resiillH. There are two major categories of 
computer retrieval systems, each of which approaches the retrieval problem .in a 
somewhat different manner: serial search Hystcnis.and direct access systems. 

, Serial search systems were the first to appear and were widely used during the 
early 1960s. With this approuch, the gollectitJn or data base tu be searched is 
normally contained on magnetic tape in serial fnshiun, Hnsjh record represents a 
document and contains the information elemenis found on a library catalog card 
(e,g,, title, author, source, subject headings). To perrorni a search, a useN fills out a 
form in which he describes as nearly as possible his interest. This search request is 
then coded\by a person familiar with the collection and entered into the computer 
(usually along with several other search requests), fhc computer is controlled by a 
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relatively simple search program that causus it to read each successive Vccord from 
magnetic tape, to compare the contents of the record with the elemcntH spccined m 
the search request;. tmd then to copy the record out to a second magnetic tape if ' 
there has been a match, or to proceed to the next record. If the collection is large, 
it can take several hours for the computer to process the search requests. Further- 
more, if the request has been too specihc, the requestor is likely to get few if any- 
results; if the spe^^ifieation has been too broad, the requestor can get several 
hundred Gitations printed out which he then must examine. Because the request 
had to be processed through an intermediary, there may have been further degra- 
dation in the quality of the results. 

In direct access systems, indexes much like back^of^the^book indexes are con- 
structed from the collection. For each Index term or descriptor, the locations of nil 
records in the collection containing that descriptor arc listed on a direct access de^ 
vice. This index is commonly known as an inverted tile. Whereas the book indcx^ 
indicates the locations of pages coniaiuing particular information, the inverted file 
indicates locations of records containing particular information. The main collnction 
is also located on a direct access device. This file is commonly called the linear flic. 
It is thus possible for the computer to^ look up a particular index tenn in the in- 
verted file, to read off thi' list of locations or addresses for the citation records, that 
contain the index term, an^ ihenjo access directly the linear file for each location 
to copy the appropriate record— either to a display, a^ in the case of an on-lme 
system, or to a printer, if this has been specified. 

Whereas serial search systems can be cnicicntly operated only in a batch mode 
(i e , each inquiry specifies the complete search process to be performed), direct 
access systems can be designed to be operated in either a batch or interactive mode 
(i.e., wherein the user can control and redirect the search process during execution). 
Typically, serial search systems are simpler and less cosily to design but are more 
costly to operate than direct access 'Systems. Direct access systems which provide 
for user interaction can typically produce higher quality results fix., a higher pro- 
portion of relevant results with fewer items missed). 

^ Tnleraelive systems can be further distinguished according to the rate and amount 
of information transferred during the search process. Systems designed for visual 
display terminals usually operate at relatively high speeds (12(^240 characters per 
second) and transfer a larger amount of information but cost hiorc to operate than 
teletype terminals, which operate at relatively slow speeds (10^15 characters per 
second), 

It was decided from the outset that DIALOG was to prDv|de maxmium mterac-^ 
lion between the user and the file. As a result, and even thougli relatively uneconomic 
at the time (1966), DIALOG was designed to include a termitlai consisting of both a 
high-speed cathode ray tube disjilay and an associated hard copy device (see Figure 
1) From the user^s point of view DIALOG consists of several plain English com- 
mands, such as DISPLAY, PRINT, and SELECT, which allow him to perform 
information retrieval functions. Commands are defined on the special characters 
above the. numeric keys on the input keyboard so that a convenient command label 
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FIGURE 2, DIALOG inpuj keyboard with a comnmmi iahcl strip. 



Strip can. be attached to the keyboard to identify the commands (hcc Figure 2), 
The commarids are ho designed that no prespcclfied sequence must be followed, 
i.e., the user is free to select any command he considers appropriate for the next 
step of the search. Consequently, the user completely controls the search process. 
At any point he can branch ofT the main path of his search to explore associated 
ideas suggested during the^ course of the search. The command key orientation re- 
sults in a very simple clerical procedure: depress command key, key in operand 
data, press TRANS key to transfer the entire message to the computer. Corrections 
arc made by backspacing and typing over incorrect chnracicrs. Following entry ol 
each command, ihv system responds wit|i information that assists the user in 
deciding the next step to take. 

Th^ final implication of the command orientation is that the search process is 
broken up into a sequence of small steps, each of svhich is very simple, and each 
of which results in feedback from the system. In this manner each step is completed 
correctly before proceeding, thus eliminating the need to reenter the entire search 
speeification in case of an error, as must be done in batchtype systems. 

In the context of these fundamental considerations, DIALOG design character- 
istics will he discussed with regard to six fundamental steps which arc more or less 
followed in any retrieval process: 



(1) Identify antl select iiulox terms ,wliich chnruutcri^e the search interest, 

(2) CiMirUinnte imlividual ternin into concept griHipH. 

(3) SHniple juid yvniuute internwdiato sQarch result 

(4) Modify (1) and/or {2) and redo 01 
\5) Oiitpiir result^j. 

(fv) Review actu;\l dociinients. 
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Machine iniplcincntation of cud, step will be eu,„pared w.lh ihe hi^UH•lcal soluliui, 

in usiiii2 the cnrd catalug, 

In mini- a card catalug. the .caieher selects a genenc noun or nuui, phrase 
related to his search interest and scans through the alphabetically arranged catalog 
entries looking for a match or a cross refcrunce. If it is a large cnialog, fmdmg ati 
aeceptablu entry can be lime consuming, Most libraries do not provide a puhhshcd 
catalog guide or index tliat would enable the searcher to identity subiect headings of 
interest before approaching the card, catalog. 

In DIALOG, two commands, EXPAND and SELECr. are provided to assist 
the user in identifying and selecting desired index lernis^ne form of EXF'AND 
provides a display of the alphaheticallv near index ternirttt^he-tcrm entered to- 
gcther with an indication of the number of citations indexed by dl^Rlayed terms,.nnd 
als(, the number of cross reference or rchitcyl terms associated w,ih eiHjh ^I'^P 
term. Figure 3 shows the di.splay resulting Trom the command EXl'AND IN 1 1-.K- 
ACTION "^ Each displayed term is numbcied for easy reference. Another lorm ot 
the FXHAND command allows the user to display the related terms in the same 
format ns that just described (sec Figure 4). The user is thus provided a window to 
the index and thesaurus to assist him in identifying useful index terms with which to 
characterize his search interest. 

The SELECT command enables the user to construct a list of desired index terms 
for future reference: SELECT entries result in the definition of file subsets (referred 
to sinipiy as sets) which arc tagged with "set numbers" and are printed out on the 
terminal hard copy device, 

The command, SELECT "COMPU'I FRS," for example, would result m the 

fallowing output at the terminal: 

Set Nil. in Descripli.m of sci 

No, set 1 : :-.or,*-z:ind, - i^niir! 
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Once selected a term (or more exactly, the file subset associated, with the term) 
mav be referenced by its set number. Citations associated with any set can be dis- 
nlaved printed, selcttlvely saved, or combined with other sets. If a selected term 
cannot be found, an error message is printed out for -the user ^^l^^ 
mntically display the alphabetically near terms by depressing the LXI AND key. 
Each term is thus validated at time of entry, and the Treiiwncy of term use is re= 



corded for later reference. ... j- 

The card catalog contains n static collection of precoordinated sub,ect headings 
(at least in the short run). Someone other than the searcher had to decide a prion the 
appropriate catecories to be provided for retrieval. If categories :,re too broad, the 
searcher must manually examine a large number of citations to satisfy a specific 

" tKcycd entries by user are shown „vqiialL.linn murks U. d^sumush Ihcm frnn, eumm»nd k.v 
eniries. 
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PROJECT ONE ^ 
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: HOE IT-- INTERACTION ANALYSIS 
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E09 IT s INTERACTION OF 

MATTER AND ENERGY I 
EiO iTslNTERACTION PROCESS 1 



FIGURE 3. Display oj til ph a b elk ally ^f^^^i* frr/f'^ to 



subject interest. If categories arc narrow, the number of critalog entries becomes 
un wieldly to use. In the tradilional catalog, there is no way of combining categories 
at search time to provide broader or more Hpccific categories. 

In designing DIALOG, it was desired not only to provide the user a means of 
reviewing the citations within a particular category, ^but also to allow him to define 
dynamically his own categories by logically combining the results of sevenU in- 
dividual categories. This function was provided in the COMBINE command^ With 
COMBINE the searcher can combine any number of citation sets m any logical 
manner Continuing the above example, assume the user is interested in the interac- 
tive use of computers in information reirieval. He might go through the followmg 
steps: 

Terrninal ouip\it 



Command entered 



SFLECf "COMPUTERS" 

SELECT "INFORMATION RETRHWAL 

COMBINE "1^2" 

SELECT 'INTERACTION" - 

SELECT "MAN MACHINE SYSTEMS 

COMBINE ''?*(4 + 5)" 



Set 
No. 



No. in 
set 

55H 

44] 
72 

2H2 
93 
17 



Dcscripiion of set 



COMPUTEI^S 

INFORMATION RETRIEVAL 
1*2 

INTERACTION 
MAN^MACHINF SYSTEMS 
l*2*(4 + 5) 



In the above illustration, the user combined concepts of ^WMPUTERS" and 
-INFORMATION RETRIEVAL" into a single category containing 72 items. He 
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PARririPATION 


4 


14 


:3 
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IT-INTFRACTION PROCRSS 










ANALYSIS 


4 


m 


12 


R()6 


rr-!NTERGROUP RLiLATIONS 


4 


172 


H 


R07 


IT=INTKRMODF. 










DIFFERENCES 


4 


22 


5 


ROR 


IT= INTERPERSONAL 










COMPETENCE 


4 


I8B 


21 


R09 


lT-\fAN MACHINE SYSTEMS 


4 




12 


RIO 


rr^STATlSTICAL ANALYSIS 


4 


7f>H 


24 



FIGURE 4. Display of r^laiCil terms of "INTERACTION." 



decided .hat he eould be more specific, and so he combined this rcsull with a new 
concept made up of categories ^iNTHRACTION" or "MAN MACHINE SYS- 
TEMS" which were obtained froni the display shown us Figure 4, This example can 
be deveioped as the cumulation of a series of very simple steps. 

Scanning the titles of entries under a particular subject category in the traditional 
card catalog allows the user to select specinc citations of interest. Frequently: how- 
ever, other subject entry points for a particular item are not included on the catalog 
card, which denies the user the information he needs to explore other related areas 
of interest which might be suggested by the citation. 

The DISPLAY command in DIALOG was designed to allow the user to review 
intermediate results. Of several formats available, that most frequently used pro- 
vides a display of the entire citation including all assigned descriptors and a descrip- 
tive abstraci if available (sec Figure 5). Supplying the full citation not only enables 
the user to evaluate the relevancy of his search to that point, hut it also shows him 
alternative descriptors he can explore or can include (using the COMF3INE com- 
mand) with other previously developed categories. Figure 6 shows the associated 
abstract that may also be displayed. 

When the card catalog user finds relevant citations, he CQpies down their call 
numbers for use in oblaining-the associated documents. If he wishes to de\*elop a 
bibliography for future use^br publication, he is relegated to copying nianually the 
entire citation of each selected entry. 

Two output commands are provided the DIALOG user which are identical except 
for the target device, PRINT outputs indicated sets of citations to the high-speed 
printer at the computer: TYPE similarly outputs .to the low^speed terminal prinier. 
Normally the u.ser will output accession numbers to the Incal printer for use in 
obtaining hard copy^^and he will use the high-speed printer at thc^computer for the 
output of extensive bibliographies, 
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HD064431 nMn07609 

AN INTHRACriVH INFORMATION UHIRIIWAL SVSIf-M; 
CASE STUDIKS ON THK USH OF DIALOG VO snARCH 
THE ERIC DOCUMENT FILE. 

TIMBIE, MICHELE; COOMBS, DON H. 

STANFORD UNIV., CALIF. ERIC CLHARINGHOUSF 

ON EDUCATIONAL MEDIA AND TECHNOLOGY 

RMQ66000 

DEC 69 

90P. 

EDRS PRICE MF40.50 HC44.60 
/COMPUTERS/ ^EVALUATION/ INFORMATION RETRIE 
VAL/ INFORMATION SYSTEMS/ INFORMATION THEOR 
Y/ INPUT OUTPUT DEVICES/INQUIRY TRAINING/ IN 
TERACTION/RESEARCH/ ^SEARCH STRATEGIES/ 

FIGURE 5. Pixpky of jull citaiion. 

At present most library collections arc not available in machine^readablc form. 
Provision has been made in DIALOG for each\ciiation to be associated with a 
second record. This record can be an ahstract it can be the entire text of a 
documenL _ 

Of more practical interest at the present is interface to automatic microfilm 
equipment. DIALOG has been used with several of these devices, any of which can 
contain full document text. 

In practice, DIALOG provides the user an easy-to-use command language that 
extends rather than replaces the concept of the traditional card catalog. DIALOG 
extends this concept by providing a means of combining subject ^categories and by 
providing the clerical facility for storing, cumulating, and printing desired citations 
in a variety of formats. 

The initial application of DIALOG occurred early in 1967 when a DIALOG 
terminal was installed at the NASA Ames Research Center, MofTctt Field, Cali- 
fornia, The system was used to conduct on-line searches of the NASA document 
citation collection which at that time numbered some 300.000 records. This data 
base was stored in a mass storage device at the Lockheed Palo Alto Research 
Laboratory, and communication was conducted over a telephone line. Durmg this 
first application, DIALOG was used principally by engineers and scientists directly. 
During the second phase of the NASA application the terminal was relocated to 
NASA Headquarters in Washington, D.C, for 12 months. By this time the file had 
grown to 450,000 citations, the largest bibliographic collection of document cita- 
tions searchable in an on-line, interactive mode. DIALOG was used principally by 
librarians diring this second phase. Usage difrerenccs between the first and second, 
phases were analyzed In a final report submitted to NASA (/)/ 

Lockheed has recently completed a contract with NASA to develop and install a 
version of DIALOG known as NASA/RECON (Remote Console), NASA/RECON 
is currently in daily operation on a NASA computer servicing twenty-three terminals 
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AMINES THF VAKIFTY OF USES FOR THE SYSTEM AT 
THE rLEAKlNGHOUSE. THE PRIMMALOC^ QUI^SITONS. 
IHE DEBRIEFING OUTFINF, AND RFCORPS OF IHI- 

evaluators* searchfs are APPENPED.; 

(SP/MT) / ■ 

FIGURE 6. Hxamplv of liispUiViihlc ahsl^iWt. 

located in NASA facilities across the country, Lockheed installed and maim.uns 
another version of this system in Europe for the European Space Research U,- 
ganizalion (ESRO). ESRO supports terminals in several Hurupean countries from 
a central computer facility in Germany (2). , 

During the past 2 years Lockheed has supplied remote terminal reiricvnl services 
to three Onice of Education facilities with the Education Research Information 
Center (ERIC) files (J), and four Atomic Energy Commission faciliiies with NucWar 
Science A h.s tracts. 

/ RoBcr K. Summit. Rcwtc Infnnnmhn Reirhvnl Fariliiy. N.07=fi8=l. NASA CR=13I8, 

Lockheed Pulo Alto Researdi Laboratory, I'alo Alto, Califomia. 
2. N. E. C, Isotta, '-Europe's First Information Retriev,,! Network.' hSKO/U.ln) Hull.. 

, Rog"r K. Smit, ERIC Online Rcm.mi 5y.«.m-y.. „/ DM LOG Online '''f^-""^' 
^Z.al System WUh ERIC Rnearch in EduaUion T/to, N.6R-70.!. Lockheed Palo Alh- 
Rescarch Laboratory, Palo Alto, Californiu, April 1970, 

RoniiR K. Summit 
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COMMENTS FROM LIBRARIANS 
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FOREWORD 



Comments regardijig the DIALOG project were solicitGcl from all the participating 
librarians* Comments wore received from 14 indivldiials fi'om a total of 7 libraries, 
both in written and tape--recorded form. The individuals are: 

© Charlotte Sakai, Reference Librarian, San Jose Public Library, San Jose, 
CaliforTiia 

m Bob Johnson , Reference Librarian, ^ San Jose Public Library^ San Jose, 
California 

m Rob Luchessi a Reference Librarian, San Jose Public Library^ San Jose, 
C allf ornin 

m Scotty McEwen, Reference LlbrariaUp Saji Jose Public Libraryj San Jose, 
California 

m Naiicy DeWath , Reference Librarian, San Mateo County Library,; Belmont, 

California ; 

I 

@ Judith Neufeld , Assistant to the Director, Long Island Library Resources 
Council^ Inc., Bellport, New York . j 

m Ann Landtroop , Head of Business, Science, mid Technology Department, 
Houston, Texas 

m Carol Vantlne , INFORM Librarian^ Minneapolis Public Library, Mimieapolis 
Minnesota 

m Lois Thomas, Head, Research Center, Santa Clara County Librai^yj 
Cupertino, California 

© Dale Thompson, Regional LibrariMi, Santa Clara County Library, Cupertino, 
CallfoiTiia 

m Alison Holtby , Reference Librarian, Santa Clara County Library, Cupertino, 
California 

- m Charlotte Doudell , Reference Librarian, Santa Clara County Library,. 
. Cupertino, Camornia 

m Eric Krlitofterson, Reference Librarian, Santa Claris County Library, 
Cupertino, California 

m Lisa Naef , Head, Adult Reference and Readers' Advisory Service, Redwood 
Clty^Ptibric Library, Redwood City, California 

/ ■ 

These comments have not been edited, but have been organised into topic areas, 
based on suggestions by Nancy H, Knight, It is hoped that the adtual words of the 
participants will provide some of the flavor of the experience, 

^ . B-2 ' / 

LOCKHEED PALO ALTO RESEARCH LABORATORY 

laCifMliO MiSlllll * iFACIs COMPANT./INC, 
A CriktihiAtV ni tOCKHflD AIICiAFT COI^OlATrdN 



LMSC-D5()2595 



b/i effects of online search on LIBIIARY IMAGE 

Librarians suffer from a bad image problem. We find people surprised that a librar- 
ian can access information without knuwing much about the subject. I am pleased as 
to what online searching docs for the image of the librarian. Online soarch is a 
strong selling point which shows people that the librarian is dealing with information 
in a modern way. 

I have found the experiinent to be totally satisfactory in enabling me to educate infor- 
mation users as to why an understanding of the organization of inirormation is impor- 
tant, and why it should be done by a professionalp as well as a subject specialist. 
It has really given a polish to the librarian's image in the eyes of business and scien- 
tific people. 

The business community initially has some difficulty in understanding that we are 
getting bibliographic citations, and that it is necessary to look at the source materials 
to see whether the question can be answered. Once they get past that pointy the 
reaction of the clients is: Isn't this terrific - we have a much better grasp on whether 
or not our subject has been dealt with in the literature. They have also found the 
printout informative, sometimes eliminating the need to go to all the source documents. 

— Vantine 

We feel that it has really been a pleasure to liave online search, and I think that we 
are riding the wa^e of the Immediate future. There are several things that we feel 
are benefits, one of them being the improvement in community relations: wc have a 
bigger audience than we had before and we are attracting different types of people. 

As far as reference use is concerned, I think that we are finding that it is improving: 
now that there are the added bases and we are using the service more. We are now 
able to answer requests for information that we could not have answered without 
online search. ^ - 
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Libraries are going to have to get into online search. The schools are pi'oducing 
maohine-oriented individuals, and people are well aware of how one can get at infor- 
mation through the u&e of the computer. There are going to be more and more 
people in the public who are not academically or business connected who are after 
Specialized information that they expect to get from libraries. 

In summary, the online terminal was a imich appreciated service. In the near future 
it will necesBarily be more or less self-supporting; we hope that we can draw together 
some Btatistlcs that will help make this possible. 

— Thomas 
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B.2 EFFECT OF ONLINE SEAHCH ON ALLOCATION OF LIBllAEY RESOURCES 

Lossons learned: A library should ask several basic questions boforo addijig online 
search service: 

— Is there a real, not imagined, need for it? How does the sei^ice fit 
into the overall objectives of the library? 

= Does the library have the necessary financial resources ^ time, per= 
sonnel requirements to develop this service? 

Will this service produce better results than an alternative source 
(cost factors versus pei^formance factors) ? 

— Will this service contribute substantially to meeting library objectives? 

— Landtroop 

The most important comment I would make to anyone contemplating the initiation of 
online search is that it does take a considerable amount of staff time- The time 
required for training, workshops, and searching has Imd a considerable Impact on 
the entire staff. 

TMs leads to tlie larger question of how online search fits into the overall goals of 
the librai'y. As in many other projects, I didnH realize when we started out all that 
was involved, but as we contiriued, I began to see that there ai^e questions tlmt have 
to be answered. The more staff time we put into online search, the less time we 
have for other services,' The question of which comniLmity to serve then arises: 
are we to serve a sophisticated^ highly educated community, or are we to serve 
the community that has no interest lii this specialized reference service^ but has 
other interests and needs that we are unable to fulfilL We are going to have to come 
to grips with this problem, I believe we have to be flexible enough to include both; 
butj we may have to require the users of online search to pay for the full sei^vice, 
i*e. , including terminal cost and staJH time so that the service does not become a 
burden on. the library system, . 

— Thompson 
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Overall, we are finding that online search r-equlres a lot of oEfort - publiGityi training- 
jmt to keep things going. It is not something that we can subscribe to and lot sit 
around until we feel like using it - like a new reference book. Each library (public 
and otherwise) will have to decide whethei" it is worth the effort, 

- DeWath 

We have uiscussed in our library the possibility of eliminating some data bases in 
paper copy because they are online, Flowever, I do not thiiilc that that is a good way 
to look at the problem, because if the online service is no, longer available for one 
reason or another, then one has no backup in hard copy. Data base availability 
implies that we don*t haVie to keep duplicate copies of materials, and that we can 
also go into microfiche to obtain an enormous saving in shelf space (we could save 
200 to 300 linear feet of shelf space by doing this).^ We could also save the binding 
cost, particularly for references that are only checked occasionally with online search. 
We can have available data bases that we could not afford to buy in paper, and it 
broadens our entire scope of data retnevaL 

Vantine 

We have faced this resource question before, A lot of the paper sources that we 
subscribe to are very expensive, and at the present time we do provide very expensive 
business services for a limited audience. If you look at the people who are sitting r 
at the business table, you will sec. the same persons being served over and over again. 

— Thomas 
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B.3 FEE AND FREE SERVICE 

Our major hurdle was the decision to charge fees in a public library. It was decided 
that the library would absorb the staff time, connect time, and overhead; the terminal 
would be paid by N. S. F. j and the DIALOG cost would be paid by the patron. If we 
did not charge the patron the DIALOG cost, we would not be able to offer the service. 
We I 'e had no requests for refunds or defaults by our DIALOG users. 

— Sakai 

The fee service uas not presented as niany problems as we had feared. If anyone 
objected to the public library seUing a service, they didn't do so to our feces. We 
have had no problem : „t I know of with patrons feillng to pay a balance due, bouncing 
checks, etc. We have a checks -only provision that works well for us. I'm sure that 
users would like It better if we accepted cash and credit cards, but no one has been 
terribly inconvenienced (although a couple of times staff members have written checks 
on their own accounts for people who showed up with cash only). We do fe^l the 
pressure of having to search economically when spending the patron's money; begin- 
ning searchers find that particularly discomforting. They have, dealt with that by 
practicing a search on demo and then doing It "for real" as a standard search - a 
luxury that we may not be able to afford in the futui-e. The standard search promises 
some relief in that situation. When we are more confident (with ourselves or the 
subject of the search), we prefer custom, so that we can get the benefit of our effi- 
ciency.' The problem, I think, stems from the strangeness of having someone else, 
in essence, pay for our time. I have worked other places where our time wa^bUled 
to clients (not libraries but consulting organizations). After a little Initial discomfort, 
staff members learned to accept the idea that whatever time we spent was billable, 
that mistakes, false starts, and inefficiency were a part of any human activity. • 

If we did enough DIALOG searches, we would eventually realize tiiat no search Is 
flawless, and that the flailing around that we do sometimes is a legitimate part of 
the search. 



- DeWath 
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Wc have had a numl^r of peopiu in library systems around the Twin Cities inquire 
.as to nonfee use of the terminal. Up to the present, wo have limited use to fee- 
paying INFOIIM clients. In 1977 a pilot study of free online searching for the general 
patron will be undertaken. The subject librarians will be responsible for determining 
whethor a terminal search is the most costr-elf active way of answering a question. 
We are finding that the average search cost runs $20 to $25 for a client, not Including 
our INFORM iibrarian fee. (We have had searches ranging from $5 to several iiundred 
dollars.)^ It is such a roasoimblc price that I feel that online searching is a tool that 
should be available in libraries everjnvhere. 

— Vantine 

With reference to our use of DIALOG to answer reference questions, I continually 
worried alx)Ut the fairness of charging some patrons and not charging others. The 
criterion sometimes mentioned as the appropriate guide - use online search only 
^•to save time^' - is not workable in actuar prEictice, .1 foimd myself looking at the 
patron's address to get an idea as to whether he or she could afford online search. 
This atfected my decision as to whether a full onl'ine seareh was recommended or not. 

/ ■ Thomas 

We are concerned more than the public alx)Ut chargiiig a fee for searches. The public 
suems to be able to separate the online service from our free reference service. 
We are going to have to set up a fund, though, to handle the times when we use online 
search for our own reference questions and for bibliographic searches, 

= Kristofferson 

Houston Public Library has a long history of doing indepth reference work for our 
patrons — for free. This Includes, of course, literature searching. If these manual 
searches are suocessfuL tiien electronic searching- is not necessary. This approach 
(doing manual searching first) certainly does affect the use of DIALOG* ^ \ 

l must strongly question Alice Ahlgren's choice of words (Vol. Evaluation Results, 
Appendix D) when she referred to the ^^attitude^' of the HPL staff with regard io a 
Ice-based service. Houston Public Library has no dlfflculty at all in charging for = 
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patron use of online computer time. li" a patron/client wonts a literature search via 
computer, he will have to pay for it. A library doos not have to have a 'Tee-based 
service" before they can have DIALOG, nor must they have DIALOG before they have 
a fee service, 

— Landtroop 
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B,4 TRAmmG AND ALLOCATION OF STAFF USmo ONLINE SEAECH 
B. 4.1 Training Programs ' ^ 

I feel that the most beneficial training session would consiit of two or three people at 
most with an experienced trainer some time after they have read the majiuals* We 
are intelligent enough to absorb the basic idea of how the system worlds from the 
printed material; in the'future It might be more valuable to read it first. At the 
training session one could discuss the finer points and have hands-on training. 

There should be training beyond the initial one- or two-day session,' preferably after 
the librariim has used the system for awhile. Advanced training should be offered' 
un-locution, since librarians find it hard to get away. It should occur once a year 
or maybe every six months, A minimum of three people should be trained to cover 
absence due to illness, job change, and differences in subject interest. 

It was very difficult for us to become acquainted with the new data bases when wb 
were not iamlllar with them in hard copy. For example, we were familiar with 
Fciundatlon Center materials, so it was easy to use it in the online form. But when 
we dealt with Chemical Industry Notes or Oceanic ^straots, which we weren*t 
funiiliar with, we no longer were confident about what we wore doing. 

Sal^al 

My trainini^ as a DIALOG operator began four months into the fee jieriod* The initial 
training was done by m experienced operator who explained the key commands cmd 
jnivu a doniunstration on the terminal to illustrate their use, iUthough encouragod 
In use dunu) time to priietice with DIALOG » this brief introduction did not give me 
enough eonlldencu to do more than one or tsvo prtietice searches. 

About UnsM' wi?ekH after tliu in-houHu training seHHlon, a IX)ckhood«BponBorud wDrk-- 
Mhop ibr nuvieu DIALOG operators miB given In PnJo Alto. Thly workBhop w(is very 
hpiiiiuL It prnHcnital n compruhunHlvu rovlow of basic 01/ 1/^)0 doarch cnmmnndH 
liiul u-rluiitjUPH, thuH ^;uliInl^riz^lg liilii mil pieeoH of key hirornuition given nwiiy 
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other operators or picked up on my own. In addition, there was a chance for hands-on 
practice with DIALOG terminals, which reinforced the information given earlier in 
the workshop. Although In-house training la useful, it is no substitute for a formalized 

practice sesslon/wprkshop. , 

s 

Shortly after attending this workshop, I began doing fee seai'ches, I did very few 
demo searches for practice. In contrast to other operators who began doing fee 
searches after some months of practice during the nonfee period, t was doing fee 
searches with very little prior experience. As a result, my first fee searches were 
rattier poor.' Errors were made in typing, command syntax, and search logic. These 
searches took twice as long to do as comparable searches done by experienced oper- , 
ators. I had trouble keeping track of the commands given and sets manipulated 
earlier in the search, and often had to go back and retrace previous steps. The fact 
that my Inexperience was costing the DIALOG patron money only served to Increase 
my nervousness and unease during those first fee searches. 

Nevertheless, I was learning. After a dozen fee soai'chos, my search time dropped 
while my confidence and effectlvenesa rose. Soon, being a DIALOG operator became 
an enjoyable occupation, and has remained so every since. . 

Becoming a DIALOG operator in the middle of the fee period was not easy. Despite 
training sessions and demo time available for DIALOG practice, DIALOG proficiency 
can be gained only by doing patron-Initiated searolios,. IJust regret that those patrons 
for whom I did my first feu seru'clies had to unknowingly subaldi'/-o my DIALOG 
education. 

- Jolmson 

Since I Icncw nothing about computer s or HCt theory, I didn't have the fo,VHiost idea of 
wliat was going on initially. I felt that I didn't havc enougli time to triun on the ter- 
minias. Another training aeasion that cnmu one inunth to Hl#VviH!kri later w:h4 of some 
vaiuo, but wo should have luul unothur followup ii montli jatur that. When wu weiit 
to the workshop in May 1075, almoHt iit the end of tho free period, we laaiMiccl about 
tIrlngH tliut we had never lionrd about l)f}ror() (ytaeking, for example). 
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One of the major problems that I foresee for oui' continued use of online seai'ch is 
tliat of not having enough searches to keep our skills current. We have seen how 
rapidly we get rusty, and how dlHicult it is to .pick up on new bases if we have no 
prossing need to use them. It is also likely that the money for training and for' prac- 
ticing online will be cut dovra or eliminated iram the budget. But, they are essential 
in order to keep us even modestly competent, especially with new bases and search 
features being added all the time. p , 

- . - DeWath 

B.4,2 StaCfing Arrangenienta • . . 

Stalfiiig has been the biggest problem created by online search at San Jose. Since 
we did not add any extra staff for onljjie seai'ch', we began to feel tlie strain as DIALOG 
requests increased from San Jose State trnivorsity''students. Fortunately, we h.nd 
help from a SJSU library school stodent who received units for her work. Linda 
Erlckspn helped us through our busy free period. . , 

i ' 

Durinj|- the period when fees were charged, the four operators, were able to handle | 
about fifty requests a month comfortably. Each of the operaiors specialized in a 
couplelof data bases, assigned according to the operator's strengths. However, we* 

conduct most of our searches in 13RIC, a result of our high student usage'. 

\ ' .1. 

I think it would be better to have a staff member assigned full time to do all the 
•Hcarehga . That person would be able to study and reeolve advanced training in each 
data base mid thereby do more skilled searching . Online search service lakes time. 
Vor every mimito online, cm operator spends throe minutes olf-lino. ,This time does 
not Inoludc the numerous inquiries wo receive. Staffing is a aorious eonsldcratlon In 

deciding to offer online search. ■ ■ , 

-SnJaii 

We woi'(! iiovur overwhelniud l)y the workhKid, but our Htaltinf? arrangoniontB are more 
n<*xil)lti tluin tlioHO of n lllu'nry which nuisi stiaf a rofuruneu dusk. Wo did huvg.Bonio . 
HllKht prohlt'iiiH Willi diHlrlbu'tinn ul' rcqut'Htri luuong the stafr. We luavu requests in 
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an in-box until someone picks them up to work on tiiem. Occasionally a request 
-would get bypassed (especially a messy one), with everyone thinking tiiat someone 
else vvoufd do lt- butjliat is more a ftmction of our %vay of distributing workload, - 
than anything directly relaterto online s^^^^^^ We have talked about assigning 
requests, either in strict rotation or according to diffetent subjects, but the staff 
was unanimous In its feeling that the current procedure was praerable, both in terms 
of distributing the workload fairly and getting the searches done with tlie least delay. 

We have avoided assipiing specific bases to individual searchers, because that would ' 
mean a heavy load for people doing the popular bases, and could mean that a request 
would need to be done In a hurry without tiie "appropriate" person betog available to 
do it. However, that would make it easier to keep up-to-date on changes in the 
bases. • • 

- DeWath 

B.4.3 Number of Operators 
/ 

From the user's point of view, I suggest that a single operator be utilized. A single > 
operator ban become a specialist; he gains more expertise by doing more searches. 
This sy/tem is preferable to spreading out the searches amqng many operators. 
■ . / ■—McEwen 

'it is important that there not be too many operators because then you have a lot of 
people who have only a sutfaco knowledgo of ho^ to porform soarchos. On the other 
hand, one operator docs not work out well In a public library situation. It Us difficult 
for one person to cover many subject areas, and from a staffing point of v^ew, It 
doesn't work out well due to illness, vacation, etc. ; 

- Kriatofforson 

n.4.4 Staff Altltnido and Ability • 

Tho key to a auccossfu] online senrOi optsration is the staff. If the people who will 
be working with it arc not unthuslastic, the use of online search service anywheru is 
almost guaranteed to fail. Tlie patrons know of online search, only through u.g, ;'.o 
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if we are ekeptical or reluctant, or not interested in the patron's question, the pataron 
will pick that up. U we aren-t convinced of its value, we can -t sell the patron on \t\ 
but, on the other hand, If we seem confident that we have, gotten from DIALOG the 
best it cm provide, however much or little, the patron is confident that the searph 
has been as successful as possible. • 

^ -"^ -DeWath 

The attitude of the staff Md administration must be supportive when a library decides 
to offer online search* Many of our early problems intensified because of a poor 
attitude. As our attitudes changed, the problems with fees, workload, and terminal/ 
computer becaine manageable. It^s because of this positive, supportive attilTide of 
the operators and of administration that DIALOG will continue for a third year ^t 

/ \ — Sakal 
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Fasbinatlng tool - but ypu always wonder if you have all the material from tJiat data / 
base* If your search strategy had been different - would you have retrieved more or 

less --or even the same citations? ' 

McEwen 

I question the v^idlty of the time sheets whore we recorded time spent In the inter- 
viev\^ and followup, I am quite sure that none of us put down the full time - we didn't 
want to thinlc we spent this much time on this activity - or that it actnally took that 
long to wrap up a search. 

- MoEwcm 

interlibrary Cooperation 

An alternative to the kind of urrangemont tliat wu have now is one in which one library 
acts as a central search facility for a largu number of llbrariea, in a more formal 
arrangement than we now have in CIN. We have !uul so little participation frnm 
special libraries In CIN that I suspect tliat ihuy never learned unough about DIALOG 
and^r the DIALiB pfojoct. rncludinij a iavmv area, OBpc^oinlly San FranclHco, 
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would probably inorBase the use tremendously. The question would arise, how would 
the cost be shared, particularly the staff costs, m the East Bay, the public libraries 
are trsang an aTraiilement whereby online search requests are sent to U.C , . It will 
be interesting to see how that works out, especially since the public librarians have 
been given no special training regarding the kinds of requests that are appropriate. 



- DeWath 
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3.5 USE OF DIALOG FOR REFERENCE 
B . 5 . 1 Reference Use 

Online aearchlng opens up a new vista for the smaller library as well as the research 
: library* It provides the small library with capabilities that they never had before 
and enables them to provide better service to the public, I would recommend online 
searching to any library that can afford it, no matter how small the library; T feel 
that it is a tool that can enhance their collection immeasurably, 

Tnterllbrary loan and other networking situations make It possible for people to get 
copies of needed materials at little or no cost. This means that online bibliogTaphic 
searching enables the person having access to a very small collection to find out what 
is available and begin to do a really decent literature search. It may take them a little 
longer to obtain source materials that aren t iimTiediately^ available, but it is well 
worth it, . . . ^ 

^ Vantino 

The ability to do fuU-teKt searching has made it,a^elativcly easy to verify a biblio- / 
graphic citation when only limited information is supplied by the patron. The ^^hit^^ 
rate for such searches is high which means thnt o. special collection like Municipal ' 
ReferencQ has cm additional tool in helping a Sometimes demanding plientolet 

- LuchesBi 

■ ^ ' i 

DIALOG was used for more Hum pntron-inltlated HuarchuH, We as librarJnnH became 
interested in the posBiblc iisos of an information retrieval system In daily public / 
library rofurence work^ o-g., blbllngraphib varifieatiou mul searching for a specific 
answer. More time is noiKled to deter mini* whether u system such as DIALOG Is 
useful refereneo tool. It is unfortunate tliit there is no current Htudy baing ecmducted 
on this aspect, ^ ^ / 

We tried using DIAU^tf In our refuronae work. Thai Is, wc^ iIhccI it lu rind a ^puoUlg 
njiHwur to a Hubjuut query . \ It wiiH used to Have HtalT tjino in HOarcHlng indtcOH (Uicl/or 

7 I ■ 
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making available specialized indices* Our "hit'' rate, unstatistically speaking was 
about 25 percent. It was hoped that the fuU-^text capability of DIALOG would zero 
in on the specific topic. We need to do more reference searches on DIAIjOG before 
any decision can be made about its usefulness in public library reference. 

^ Sakai 

Five of us received a one day DIALOG training session at the library in Au^st. 
After the training session j we practiced diligently for a while and talked witii our 
friends here in the Twin Cities who had the sysfenip tidying to find out how to best 
use the system, 

. ^ f« . 

Originally we limited online searches to those that we taew would be successful , 

i.e, , tiiose that we could plan a strategy for, and for which there was a data base 

we knew had the material. We did not do much In September and October becai^se 

' none of the INFORM questions seemed suitable, for online search* Hosvever, our / 

searches in November indicated that there was a great deal of Information in the bases 

which could be retrieved once we became more base oriented. 

Because of a newspaper article in September descpblhg INFORM and our online search 
capabilities, the request for our service increased quite a bit, Peoplq were interested 
to see what the computer could do for them, As the? number of searches on the system 
increased, our profieiency increased; wo used the logic more effectively, truncated 
more efficiently i and began to understand the pccullarltes of each data base better. 
Our searching results than bugrm to show a noticeable improvement. 

As DIALOG added new baBOS BUch as Science Citation Iiidex mid DlBBertntion Abstrn 
we were nble to do saarches that wo had not boon ably to do previously^ and we 
developed additional skills for Chom Abstracts aiid lor NTIW which have boon niost 
^ l\olpfuL / 

We fool that DIALX:)G unhancud the Hcrvlcu that wu provicU^ our paying elientB numy^^ 
fold. It hn.H provided an uffluiuiit, InturcHtingj aJul informatlvu backuj) Hurvloe to 

7() 
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the Vinds of research that we already do. It has also enabled us to handle questions 
that foxt^erly we would have had to subcontract because of a lack of sufficient 

resources. ^ 

\^ V^tine 

B.5,2 Data Bases \ : 

\ ■ - ' "^^ 

We find I^TIS most valu^le - it provides us with information that gives us good leads 
to other sources. We have found it a fast, efficient base to search, and weVe had 
excellent results. We^ra gaining more experience In CAIN and like that base very 
much also. 

Psych Abstracts has also been invaluable. It is a difficult base to search manually 
and we can find a great deal of material oiiline that would not be cost effective to 
obtain by manual search. We had never realised the wealth of material to Psych 
Abstracts until we used it in the line form. The Foundations data bases have been 
of great use to our Sociology Depwtment wMch is a regional repository for these 
xnaterlals as well as to INFORM. 

The one frustration we have had In using tiie system is that Food Technology AbBtracts 
is not online In DIALOG. It Is something we use constantly and it is very cumbersome 
to use manually* There are so many cross checks that have to be done that we would 
really appreciate having online access* If Food Technology ^stracts had been online 
we would have easily doubled the number of Bearchos during the trial period. 

Vantlne 

DIALOG provides several files which are useful for urban research. The most per- 
tinent is probcObly NTIS which, with its strong base of government-sponsored research, 
coyer s many ai^eas of interest to municipal managers. In recent months, fpr exainplOj 
Son Jose Municipal RGferonco Librai*y has conducted searches in NTIstor city staff on 
such subjects as computer desigTi of sewer systems, pedeetrlim safety, urban goods 
triuiaportation, bus transporttition, energy consorvation in buildings, and health needs 
aSBeasmont* The results of our soarchos in NTIS have generally boon very good, and ^ 
the flgxlblUty of Boarcli teclmiquus has greatly simplified access to tJiat l)Qdy of report 

77 ' ' 
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literature. Other files, such as Compendex or ABI, which focus on certain aspects 
of public works, personnel management, administration, finance, aiid the like, are 
also valuable in supporting an urban aflairs reference service. 



\ ^ Luchessl 



Our biggest problem is not having ijiformation.^out the data bases. Data bases 

have been added and we have not received instructional material until several months 

afterward. We have not had specific training In the use of most data bases. Pre^ 

dicasts was on for a year before v/e learned how tdxoperate it/ There are some new 

bases online for which we^may be using the wrong techniques because we are basing 

our approach on the brief blurb that was in the Chronolog- 

\ — Doudell 



Individual thesauri for each data base would be a b^help, 



\ - McEwen 



Having Lockheed staff as close as a local phone call has been helpfuh Upon occasion 
we have asked for help in more tecimlcal data bases* 

- McEwen 

i 

B.Q.3 PresQiice of Patrons miinng Sotu'ch ' 

■ One point that should be emphasized is the importance of performing searches with , 
the patron In attendance. From our experience it works much better; one lin'ows , 
exactly what the patron wants. 

- Krlstofferspn 

D.r3.4 Location of Ternvlnal as Factor In Usu 

Wo are one library in a group of 13 count jllibr arias. Although we have sent these 
libraries promotional matorhil, we have nk l)een receiving nirmy ciucations from them. 
Most people who have eomo in for aearchos cither have contacted Ms directly or are 
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people who regularly use out llbraxy. The fact that the computer terminal is not 
physically present at tliese other libraries seems to malce a differerioe. 

- Doudell .. 

I believe that the patron is more attracted to online search if tiie terminal is located 
in his local branch. We were surprised that when we mentioned the possibility of 
using the more expensive TWX for the third year j we had sbnie^ patrons who Imme- 
diately volunteered that they were willing to pay the extra cost rather than. go to a 
more distant library, ' | 

Thomas 

/ 

Use of Offline Printing . ' 

We rarely use offline printing. We feel that the three or four days bf waiting for a- 
printout is a detriment for most of our questions. We use offline pointing only when 
we have long-'term projects or when the person indicates they really do not have 
immediate deadlines. Three or four days is too long if you we in|terested in a , 
business question. The businessman generally waits too long to ^'sk tlie question, 
and he must have his answers as rapidly as possible, / 

1 Vantino 

/ ^ 
-.1 

B,5.6 Record Keeping / 

\ 

Our major problem has been reconciling our Locldieed/DIALO^ invoice ^against the 
amount we collected from the pati'on. A usage log containing date, data base, tinier 
seoi'ch number J and cost was a nucossary record for vorifying the DIALOG invoice* 
It would be bettor if the cost could be provided by DIALOG along with the online 
time at the completion of each Beavch,* 

SaJcal 

One of the diificulties wo experienced was the record kooping* , We have had the 
logs to keep and the monthly reports to pruparc. Also, one of thu biggest pains is 



* DIALOG now providos the cost Information online after each search, 
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computing the cost of each search- for each data base. We recommend that an online 
search service should indicate the cost for each seai'ch. The different costs for 
each data base leads to time-consuming computation, and also leads to errors. Wd 
seem to spend as much time computing the cost of a search as doing the actual search 
online. 

- Holtby 

B.B.7 Reliability of Service 

Tymshai'e and Telenet give us more reliability problems than DLfVLOG does. We 
have only been inconvenienced once by a DIALOG crash; the other times we have had 
a connection problem, fii general, we have had very good service indeed. 

- Vantine 

/ 

B.6 NEED FOR PUBLICITY TO PROMOTE USE OF DIALOG 
'b.6.1 Publicity to Library Staff , 

It is important to establish a base of support within th6 library by rumilng training 
sessions for librarians who might forward questions to the seai'ch center. It is 
important that staff -members not feel left out. They should not regard the online 
search system as a special tool clos^ to them, but as something that has practical 
application for every reference librarian. 

We had ten or twelve introductory sessions lor ataif members of any level who were 
interested, from the janitors right up to the diroctor; We had a total of siKty or 
seventy people who attended , out of a staTf of 220. I explained the online system to 
them and how it is used, imd wo ran demonstration searches. Each department was 
asked if tliore was a professional staff member who was interested in online searching 
' About twelve librarlfms were then traiiiGd more intonsivoly on how one sots up a 
setu'ch strategy and were given time to practice on the terminal. Borne of thoso 
pci'sons hf^e practiced and some have not, 

- Vantine 
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Regarding sidelines for public libraries considering online service, I would empha- 
size maldng llbrai'iaiis familiar nnd comfortablG with the. service through demonstra- 
tions in smaU groups and in fanilliar subject areas. Once the librarians are 
enthusiastic (as most of them are after having seen successful demonstrations), 
likely search topics seem to flow In, , 

- Neuf eld 

It should be pointed out that all of the rtm members here have enough taiowledge of 
online Bearch to be able to answer patron questions about the system when the search 
staff is not available * 

^ Kr i s toff er son 

■. ' ■- • . ■ / 

B,6,2 Riblieity to Other Librar lea 

Branch librarians will also remain a problem forever more; They don^t care enough 
to spend the time to leam eyiough to taJce the initiative in generating online search 
requests and wiU have to be relied on merely as a pipeline for users who have already 
decided ttiat they want DIALOG searehes. They simply have too many othfer things to 
worry abouti DIALOG is too low a priority. Most, however, are willing to relay a 
requestr now that they haV^ tried it a few times and no one has bitten them, 

" DeWath 



It maybe that wo should provide more information to the librarians in tliese other 
librai'ies so. that they will have a better idea of what online search Is, and what it 
can supply. Although I don^t operate the terminal, the littie knowledge that I have is 
important In that it helps me answer questions al^out online seai^ch when I am at the 
reference desk. Those who are not fanilliar with online seiu^ch can have an erroneous 
idea of what the true ccyDabilities of the system are with respect to a given question, 

^ Thompson 



We feel that the time was not sufficient to make all librarians aware of the ways in 
which the program could be of service to them and to their users. We have not yet 
siuocecded In reaching the entire potential clientele but think we will in time, I 

Bi 
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think the committee and the board ai^e convincGd the service is worthwile. More 
spadework has to be done to reinove objections of librarlaiis to charging for services, 
and hesitation to suggest methods witii which they are not fanilllar, but this too is 
easing with .time, 

— Neuf eld 

Beside the newspaper ai*ticle, we have done no outside publicizing of the online ser- 
■ vice other than at meetings such the local SLA chapter , the American Law 
Librariajis Association, and an American Marketing Association seminar on infor^ 
mation retrieval. We have also discussed the serylce witti librariariFTOroughoi^t this 
region. We try to make user% aware that online service is necessary if you ai'e 
Ideally going to do a good job for most business and technical questions. 

— Vantine 

e;6*3 Publicity to Patrons and the Community 

We have not used handouts or other printed mater ltd for the public, iiowever, we 
have tajceh the oppoi^timity, whenever possible, of performing demonstrations ior 
business people. When we receive an Inquii'y from corporations concerning the 
system- we try to arrange for a demonstration. There has been an Increasing imd 
continulne Interest In what is available online. IC we feel that an online search Is 
relevant to a question, then we mention this to the client indicating the possible 
results of the search and the possible cost* In nme times out of ten, the client is 
Interested in the computer search. 

— Vantine 

We had discouraged publicity because we dldna have the staff to hajidlo more questions, 
but publicity ia a chickcn-and-ugg situation: ti: you don*t htivo the support for the 
staffs you can't publich:e the service; but if you don't publicise the service, you don^t 
get the demand and you can't get support for the stolf. We may have to go through a 
bud period of pushing the service, contacting business, technical, and professional 
groups In order to build usage. THon, we can attempt to charge ai:ec to cover atalf 
time. We havo not public! izod the way Rudwood City has, and Btill the word has 
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y[)re:uU About ,10 purconl, of our searclicH iiru for business clicntelu, bat tlicro v6 
s-uiiiK Lo have to be n lot snore publicUA- if wr wnul in promotP DTALOCI to roach all 
potential uHcrs. 

■= ThomriK 

Publicity will remain a problum loruvur mavu. Musi; people don't need onluie Boarches 
Cruquuntly enough to qunlily as repuat user a. We'll alwaya bu trying to lind lUid sell 
new users. Fewer users {fewer diirin^v the free period) moan less word-ol-mdutli 
publicity, which still accounts for most of our liUHiness. 

- DeWatli , 

We have some patrons who ai-e computer e>q3orts who taow exactly how the system 
will work and what they waJit when they come in. Wu have the opposite extreme of 
people who know notlnng about computers mid who are misure as 1« how to expruss 
their requirements. We therefore' spend a lot of time exiDlaining- how online som-eh 
works and what is required, and wo make tliis cxplaiaation ovor and over again. The 
examples in our handouts have not been thorough enough to give patrons an idea of 
what the steps are in formulating a search strategy. It would bo nice if they could 
look at somothlng before they come in. Usually we must imU out a search that we 
have already done to show them how the system works. Many times they still don't 
understand, maJdng it difficult to produce a satisfactory search. 

- Doudell 

H.7 WH() AJUi THE tJSKRS (AND NONUSI^ltS)? 

Our experience was shaped so much by the user ~ cuUege students doing term papers 
or theses - wlierc Uv-v just want.<Ti a bibliugraphy to include. I liad a feeling diat 
most of them would never look up the acUiiU article or docuraent, but would just add 
the full list as tlieir bibliography. Although this was not true of all eases, the majority 
gave iTio this feeling* 

MeEweii 
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The rosponno from u.urB has hccn favovahlu, Ihnt is, from those who have actually 
u.ud IL, l)ut U>u majority ol our uH.rs aren't inUMa-siod. 13y CavorabK-, howovur, 1. 
mann lorn than overwholming - the world is not beating a path to our door. No doubt 
as more data bases trrc added DIALOG will appeal tQ aiore j)eoplc, but it will still 
appeal mainly to scholars aiul resuarcliers , aad to people whose businesses nxc 
dirbctlv related to subjects covorod by DIALOG. These are not the people wIk, lorin 
the liaclibonc ol the public liDrm-y, much a« we like to believe that tliey are - tew 
scholars and researchers think of the publlo library as a resource. We would Hke 
to chmigc that, and DIALOG caii help us to ehangu that, but it m a long, slow change. 

- DcWath 

WO Imve worked wltli the Municipal Information Library to answer questions posed by 
the mayor and other city officials. There is active support from ou.- city officials. 
They are aware thui a tool is available to locate imporUuit information for their need 
In a short time, 

' ^ Vnntine 

There may bu more referral from bra^iches than we roalizc, since some of the 
patrons who call us directly may have been direotud to us by their branch libraries. 

Thomas 

Our county librarian. Barbai^a Campbell, felt that it was important to provide free 
search for the county departments since they provide certain services to us. We 
were disappointed m the degree of county interest. Only the Plamilng and Public 
works Dspartments came to our demonstrations; there are still many departments 
that apparently have not discuvored what we can provide through online search. 
Nevertheless, we have done a fair immber of searches for PlanninB and Public Work 
ajid also for tho Healtli Department* 

Thomas 

we went to the county offices and gave a luimber. Qr3emonstrations . We haven't 
charged the coxmty departments for any,of the. searches that we Imve run. However, 
we havlnnoi received the response that we though we would have. Wo had looked , 

■ ' ' ■ ' 8,4. 
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to tlie county m one outHiae Hnurco of dpiniiiul in ihu future, rind we had thnuKht 
that a demand would develop and thnf ihi'v au^/ii tHdp with sonio funding '^-^ Mip 
i^iturG, This was a big diBappointmcjnt Lo ut^, 

-Jloliby 

B. 8 ADDiriQNAL COMMENTS 

This sectioa presents additional jomments tliat arrived too laU' to bo incorporated 
into the previous topic iormat. 

m Lisa XL Naef, Head, Adult Heference and Reader Advisory ServicOH , r dwood City 
Public Library 

; ' ' 

Survirig u pnpulntiQn\)f uppruxinuitely 55,000, Herlwoud City Publiu Library lias a 
main llbrarv Hitualed downtown, a branch in a reMidential areu. and HupporL; a Mnali 
lir}rary in a uomniunity center. 

Our computer terminal wan allocattui to the iiedwotKl City Public\Libraryv(henue after 
referred to as IICPL) which wa-^ plneed in tiu» main library rrfi-rfaice/readmg roonu 
The terminal is 'Western Union Data Herviee^^ :iOO Lajiaul l^MnUM' at 30 characters . 
per Heuond and is not portnble. Althtjiii^h we do not raiforco a sib-nee uuclc, we 
received HO many com[)biinl;s about the noise the terminal KenerLijoH while in Kervice, 
NSF agrted to provide an acoustical cover tiie machine. , >\nvc the cover was ^ -'^ 
installed, nvc havt^ bad no c3omplaintH uboul \\U: nolHcs 

I 

The RCPL reference staff is five libra^Mani^ (fncludui;^ the uint suporvisor). AH live ^ 
librarians are searchers on the DIALOG systam. Bach librarian attended one 
all-day introdujdtory workshop on computer seAreh teuhnitjues. Any additioiial hUIHs ^ - 
have been acquired by experience and tlu^ use ox manualH provided by Locklu H-d 
Information Sy stems. . \, 

^ ^ , . > , ... 

The five llbrarianK are gencralists, although on^i staff member, Mr. Thoinas I\anij 

has a morc4pecial1zed knowledge of business, s|ienQe, and technology than the other^, 
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Until l^^bruary, 197(1, lU:i'L ■•an Llie uompulcriztHl inlorimLl Icn r.,Lr..val .system on a 

nu( ihe pianrun-i of a search slriUefiy and tho .xplnnntion. to Lhu imtron 
took uu so nu.ch time. began to ro(,u1ra that appointments be made. The computer 
in online only until Q:f)0 p. m. Monday throiujh Friday Pacific Standard Time, mid noon 
on Haturdavs. Fridays and Saturda . were not good days to run DIAI.OG ..arches as 
UCPL in shOLa-^staffed on those two dayn eaeh week, duo to rotating weekend scheduler 

Smce June, 1U7D, we found that most DIALOG systom users were graduate students 
doing research papers or dissertations. Few users were repeaters. Somq4?uslncss 
firnis, prin^arily engineering firms, used the DIALOG system at RCPL. Most users 
of our DIALOG snrviees were not Redwood City residents, nor were they employed 
in Itedwood City. In faet, 50VL of the users did not reside or work in our coanty. 
Tiu. n.aximum numter of searches we vim any one month was 30; the minimum was 
7. We fpand that the staff spent anywhere from W minutes to one=and-onc-halt 
hours in explaining the DIA 1,0G system and planning a search with a patron. We 
tried to encourage natrons to be with the searcher when we ran their searches. 



Not Lmr. used to elmrglng for our services okuIu us perhaps loo aware of the cost 
faetors of U>e searching. We tlum spent a great deal of time preplanning our ..arches 
and rlrnn rumung a very tight, preplanned strategj' on the computer. Many patro.^s 
sta..<! rnxM^.^nm-r^T'^ =^«rviees because it cost less than going 

'i:ri;v:here. Frequentlv patrons asked us untmit Liie cost of the.r search to under 

Of). This reriuest increased the anxiety of the librarian who often felt her under^ 
standing of the data bases left much to desire and the patrbn,would not get what he 
was paying for. 

..aso this anxiety and to be fair to the patron. I would recommend that money be 
allocated in l|udBats to absorb the cost of errors made by searchers (such us running 
the soarch iq the wrong base). 



[A r.C)(} has 



expLUided from 2U bases to over 30 in less than 0 months. As mOrc> 
P,, h,aded onto the system, we at RGPL became less sure of our 
.,,,au.s .0 Hu-et patron requaets. Some of the files were problems because none of 
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us have either the subject knowledge to uncle vstaiul the search request or an under- 
standing of the atandard.s luul procedures used in compiling Lho index or abritraot 
services being tapped. In bases like BIOSIS , wo had problems comprehending tlif 
difroront codes ruid deoiding hosv to oombinc Uicni lo "liiL" what our jialrnn wnw 
seeking, hi my opinion, libraries who offer this type of service svill liave to send 
their searchers to indepth training sessions on the Btructure of the data files imd 
to more advanced wnrkshopa on computer manipulation. I^ibraries will have to 
budget time and money to wend tliclr searcliers to the various HeminurB offered by 
the "publishers" of the different data bases. Costs range from no charge to $150 
or more per person per session. 

The five librarians who provided DIALOG scrvlecs at the Redwood City Public 
Library have come to some conclusions about the scrviceK. While the Idea of 
computerized information retrieval is very exciting, the DIALOG bases are too 
■ specialized bibliographic tools, EUid too costly to be used by Uie general public. We 
believe these data bases probably are put to better, more frequent use in a Uirger 
library. Our medium-size library does not have the periodlual and document 
collections to provide the materials cited In the bibliographioK obtained through the 
computer. This lack menus that our patrons either have to wait for us to obtain tiie 
desired material by intorlibrary loan or they go to fuiolher source. If tlie lU-ader's 
Guide to Perlodieal L iterature were computerized or local statistics such as the 
crime rates in town, I think information retrieval serviceH would lie used by iUnhvood 
City residents. The DIALOG data system is not the ideal one we should be orforing. 
Although we started this project with great enthusiasm, we find that we do not have 
enough staff to offer as good a computerized information retrieval service as should 
be possible with DIALOG. Wo do not have the time to Lake several hours each week 
to study the manuals and to practice on the equipnient. 



DL\LOG did not lead to an increased use of our library as a unit by cc mmunity 
residents formerly not llbrai^y users. Most DIALOG users came to our library for 
that purpose only: to get a s^;arch done. 
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'At the end of the NSF grant period, blALOG worvicOB were dlsoontinued at the 
Rodwuud CiLy Publia Library Tor thu reiibons I've doHuribed, llowover, svu did guin 
an invaluable expuriuncu in the use of eonipulers in the library. Additioiiully, we 
reinlureetl and ini[irovtnl our rtM"ercMiue interview tc^uhnlfiues in wniicini^ uul Hi^iinMi 
requuBtH with DlALOCl UMers. We hope that when ckita baneH that we feel can be 
more tipprDpriritely UHecl in a Hmall library are uomputerized thrit we will be able to 
offer siuOi Herviue^ again. Ma\ OHuar FiVHuhein w^tui inoHt luMpful li u\ LhroiiLj;hoLiL 
tlie NSF projcGt as were hia eolloagues in Loekliuud Customer ServiceH. 

# Barbara J, Campbell, Coiuitv^ Librarian, County of Santa Claa;a 

The Santa Clara County Library through our membership in the Cooporativc Information 
Network (CIN) waB invited to participate in the oxperimeht to show the value of the 
DIALOG service in a public library setting. 

Several very positive results can bo identified. First, in my mind, is an expmision 
in visibility to different segments of our eomniunities. It seems increaBingly ai)parent 
to me that if libraries are going to ^^nake it'* during the next decado in the scramble 
for the limited availablo funds, the library program must be madG maro vital and 
importimt to the community and particularly to the pom.munity leaders - Uxobq con- 
trolling the funds, DD\LOG helps dramatically in this area, A segment of our public 
discovered that the modern public librai^y^ has a sophistication beyond what they had 
Imagined. Equally iinportant in our casos major segments of County governjnent were 
made aware of DIALOG-s value, and I expect tliis to have very favorable long-range 
impact. This happens to be a current "soap-^box^- of mhv2 — that libraries must use 
every conceivable way to be come importiint to their communities, DIALOG helps. 

Second ai'e the benefits to the staff. Our staff, while feeling pushed andpulledj 
enjoyed the experience — the challengei the oppoi-timity for pr^ofessional growths and 
the pride in offering a new dc[3th of service. 
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Now tu explain why (IrupiKKl LIk* ])ro|^n!i;i tluH year. In our area, cm in'moHt placeB, 
wu uro invc^lvcui in cooporativu otforta, and we arc active in our South Bay Cooporativo 
Library SysLein. Tho Santa Clara County Library Ly a group of uomniunity librarioB. 
My hofit' iH that wo will nffor the boHt in clirtH't cuininiunity library riorvicOj given 
linutod iunclH, This year wu have had to face program cuts to balance to available 
funds, in the DIALOCl expciriiiient our County luiB had two tormir In, at our Cupertino 
Library and at tho San Joho Public Library, I'sage currently BupportR one tcn-ninal 
for ouj' region, and I feel wo should follow the struature of our cooperative system* 
llieruforo, tho one terminal should bo located at theaan Jose Public Library. 

As far as adnunistoring ibn prograni, any proBSure was not on administration, but on 
staff. Our Department of Financ-e lias always taken a most helpful attitude in working 
out n(nv prof^rams in the UKist dirnct and un^.: anplicateci way, ho we had no problems 
in setting up the program, 

Beoause tho staff wanted to give the survico, they nunimizcd the problems, and they 
wxjrked out solution.s. 

e 'Punier L. Kleteher^ City Librarian j City of Ran JosUj California 

I have heen moKl pleased with the success of the DIALOG project. As our first 
experiment with on^lino Information retrieval ^ the project has been a valuable learning 
ex])crienue for administrators and reference staffs as well as the general public* Wo 
have been given tlie opi)Ortunity to observe ^ first hand, the benefits of this highly 
HOpliisticatcd service J and feel that a new dii^;tnsion in library service has become, 
available to us and to oiir patrons* ' ■ 

At tlu:^ outset, two concerns surfaced from ourjaoint of vicw^ First ^ the Cooporativc 
Infoiaiiation Network Board of Directors took on the project without getting input to 
any extont fi'om tlie public libraries who would have to do tho work. Second ^ Locldiccd 
wasdicsitant about releasing budgetary infoxniiation about the |)roject e%^en though it was 
supported by public funds. 
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During the hut-, period, the primary proldcMn I'aoucl wan Lh:i(. uL' imukuitinte HtalfinM-. 
'rhc Snn Jorie Library had lu.sl tiiirlonii i)n,sit.luii;n in U)7l-70; all Iroin Lhu Main Library, 
Urcnuso of lh'> faet lhat no stiilTinu liaci hvvu hivimhal tiiroun-h din NKF DIALOG i^rnni, 
our ah-uudy depleted ritalY reHuureu;i were t'urtlier Htrainod a- DIALOG becanio a high- 
deinaiul hierviee. A ylalT reeonimondaUcm to Lurininato the experinient wuh carried to 
the City Gouncil. Council chose lu continue tlie project, Fnllowiiig tiiis uctipn, it be- 
(•aine nocessavy to adjust and rescheduln DL\LOG servicu hourM. It is clear that 
stttfl'infi is a sijrnificant l}actor in the succesw ot: DIALOG sorvice. Wo would urge :uiy 
potential DLM.OG user to .^)propriate adeciiiute additional fundK lor personnel prior to 
itistaUing the service. Wo do not Iced Unit lilwary patrons can benefit from the ser- 
vice to the fullest extent if overall staffing resources are strained. It follows, too, 
that staff enthusiasm for DIALOG may wane under adverse staffing conditions. 

The fec/iiorifGO issue in public librarieH is a plulrsopliical iiuestlon that was discUHscd 
thoroufflily by San Jose Library administrators. The decision to charge fees was made 
by the City Librarian following this discussion. This was clear, choice in view of the 
fact that, since no funds could bo budgeteri, a nonfee deuision would mean removal of 
the seinace; a service which had proven itself valuable to our {latrons. 

We have been so favorably imprcsKcd with llie service and information uvailablc 
through DIALOG that wo are considering the poHsibiUty of an additional terminal for 
" our Municipal Rofercnco Lilirary wliich lias just been moved to City Hall from tlic 
Main Librarv . 
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C. 1 SAN MATEO COUNTY LIBRARY 



James W. IJuckluy, County Librarian 
© Anna M. Scott, Reievanoe Coordinator 

© Nancy Lewis, Rererence/Dacuments Librarian (transferred to another 
Division 5/75) 

m Beth McNabb, Reference Librarian , ^ 

m Joan P, Tobias, Reference/Documents LibrariaJi (from 9/75 to date) 

© Nancy DeWath, Reference Librarian (left project 5/76) 

m Wayne Smith, Reference Librarian 

m Nancy Crabbe, San Mateo County Dept of Public Health & Welfare Librariaii 
m Eveljm Helmer, Pubiic Information Coordinator 
m Dennis Nolan, Staff Artist 

Mr. Bucldey gave his approval for our participation and encouraged usage and demon- 
strations for County Branch Libraries, PeninBula Library System Libraries, and for 
Comity Govorninent departments, . ■ 

Ann Scott. Nancy Lewis . Nancy DeWath, and Beth McNabb were the first trained 
operators. Nancy DeWath did most of the work in developing forms, logs, and 
Initial training of staff. AH these reference librarians participated in demonstra- 
tions in libraries, at organizational meetings, and in County departments. Wayne 
Smith was the last librarian to receive training in the group of librarians on the staff 
at the begitming of the project. 

Joan Tobias received the training after she reported to the Reference Division and 
has been a Dialog researcher ever since; she completed the Predicast special train- 
ing course in December 1975, 

Nancy Crabbe, librarian for a departmental library, was trained in DIALOG because 
she was a heavy user and this reduced the workload on the County Library Reference 
SUilL 
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Evelyn HulJiier in tlu^ Ban MatCH) County Library publiu inforniation Coordinator and 
kept up a flow of publicity for San Malm County Library. Demiis Nolan, stafi: artist , 
contributud icloas for local diaplays and publicity brochures which servo to attract = 
atlcntion* 

Ail tht; puoplu liitud oontributud time and uf&rt in support of the project as well as 
the reinalnder of the Reference DiviBion staff who had to cover while the Roferoncc 
Librarians were at trainini^ tiessions and demonytratiuus. 



Anna Scott* 
lleferencu Coordliiator 



C. 2 REDWOOD CITY PUBLIC LIBIIARY 

First Year: Sally Drew, Librarian IT I 
Thomas Kam , Librarian 11 
Dolores King , Librarian I 
Alice Tabari, Librarian I 
Lucile Benedetti, Librarian I 



Second Year: Lisa 11, Nacf, Librarian III 
Thomas Kam , Librarian n 
Lucile Bonedt^tti , Librarian II 
SuBan Kaplan , Librarian I I 
Linda Lindeon^ Librarian I 

Each of these persons acted as interviowcr . soarch operator, and did the foliowup 
work with plalog users. 

In addition the Librarians HI coordinated assipiments, kept the account books, and 
made reports. 

Lisa H. Naef 

Head, Adult Reference and Readers* 
r| Advisory Services 
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C.3 SAN JOSE PUBIJC LIBRARY . 

© Beverly Chaiioe, Office Supervisoiv handled DIALOG iiivoice/billiiig 

m Rose Crimi, Administrative Sorvices Officer, established administrative 

procedure involving DIALOG 
m Homer Fletcher, City Librarian, approved and supported DIALOG 
0 Bob Johnson, Reference Librarian, DIALOG operator 

# Charleen Kurotsuchi, RGference Librarian, DIALOG operator B.r\6 DIAUB 
liaison 

m Rob Lucheasi, Reference Librarian^ DIALOG operator 
© Scotty McEwen, Reference Librarian, DIALOG operator 
© Richard Rendler, Chief, Public Service, administrative liaison 
© Charlotte Sakai, Reference Librarian, DIALOG operator and DIALIB 
liaison 

© Katherine Devonshire, Typist Clerk, handled DIALOG printouts and statistics 

# Dorotha Edwards, Typist Clerkr Ka^dled DIALOG printouts and staU 

Charlotte SaJcai 
DIALIB Liaison 

C.4 SANt4 CLARA COUNTY LIBllARY (CUPERTINO) 
Credits are due to: 

B arbara Campbell . Santa Clara County Librarian, for her agreement to allow partici- 
pation in the NSF Study, providing space and allowing staff time as needed for planning, 
meetings, reports, workshops, and DL' :X)G demonstrations m<i searches as required 
throughout the project, and for her enthusiastic support of the investigation of a new 
dimension in library service. 

Phyllis Levme , Supervisor of Adult Services, Santa Clara County ^ibrary, for her 
participation In the organizing and planning of the project as It operated in the 
Cupertino Library and elsewhere. 

Lois Thoma s, Reference Librarian, Santa Clara County Library, who, as head of 
the Research Center, managiid the DIALOG program at Cupertino Library. 
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Allison Holtby , who has boon ChioC lloportor for the Cupertino operation aa well as 
a DIALOG demonstrator and suarchor , and whose ideas as well as tinio and effort 
contributed much to the progx'am, . 

CharlottG Dou dgll, whose skill and previous knowledge of machine searching added a 
groat plus to the project at Cupertino. 

Eric Kris tofferson, whose scientific background coupled with knowledge of automated 
retrieval systems promoted a high degree of expertise in the Cupei^tino program. 

Dale Tho mpson , who , as Regional Librarian in charge of Cupertino Library , has 
constantly coped with adjusting schedules and workloads to permit DIALOG to operate 
smoothly for the benefit of patrons and the project, 

Cheryl Mout on , now with Richmond Public Librai^j who enthusiastically partioipated 
in the early stages of the program at Cupertino , giving domonstrations and oondueting 
searches, 

Mary Ferber , now Order Librarian for Santa Clara Couiity , who devoted time and 
enei^gy to the Cupertino pi^ogi'am in the first months of the projects giving demon-- 
strations and conducting searches. 

# 

Lois Thomas 

i llead^ Researeh Center 

/ 

C.5 MmNEAPOLIS PUBLIC [..iiRARY (mFORM) ' 

o Joseph Kimbroughj Director 

o Carol L. Vantine-WFORM Librarian 

© Carol 11, Jurusik-INFORM Librarian \ 

B Amy E. Raedeke-MFORM Librarian 
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C,fi CLKVELAND PUBIJC UBRAHY (FACTS FOR A FEE) 

Q Ervin J. Gaines, Diroctor 

m Ethel L. HobinKonj Head of Main Library 

p Joan Davcmport, Faots for n Fc^e Consultant 



a David M. Heningtonj DirDctor 

o Ann Landtroop, Headj Business, Science and Tochnology 
C. 8 LONG ISLAND LIBRAHY RESOURCES COUNCIL 
m David Wilder, Director 

© Judith B* Ncufold, Assistant to the Director 



0.7 HOUSTON PUBLIC LI15RARY 
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This appendix preBunty tho Snn Jose Publiu Library proccxlures for fee collection. 

Tho prooeduroa arc typical of the accoimting ahores raquired of the librariiin, 

CITY OF SAN JOSE, LIBRARY DEPARTMENT PROCEDURE FOR ACCEPTING 
MONEY FOR DIALOG SEARCH 

c DIALOG OiDcrLitar 

1, Explains the two typos of DIALOG Hoarahes available, and detormines the 
type of search the patron wants. 

2, ReeoruB information requeBtcd in DIALOG Soaroh Lug except for tlio time 
and amount. 

3, Filly in type of search, dateB, amount, Bearch number and si[rnnturej on 
t\vo-part DIALOG Search Agreement, Form 530-n4{U 

•L Has patron sign agreement and take duplicate copy to th(' ca^;ll register id 
thv lieturn Desk. 
o Return Desk Staff 

L RingH up $n, 00 for StLmdai^d Searoh or $5, 00 for a Custom Search uning 
^^N^* key on canh reginter to reeord feu (Revenue i/OO U():.i2H 1-01 ) 
a. Returns Hearch Agreement to the patron along with the cash reecMpt. 
FiiHtiaicts patron to return the copy of the ugreement with the cash 
register to tht- DIALOG Operator. 
o DIALOG Oporator 

L Rt^uorfb; rfUMupi nundie)' on original ^uid duiditnite C(Ji)y c» n^areh AgriH!- 
na.Mii, 

Procec*dH with search. 
:j. Standard Heurch Onl£^ Give Heareh inforniation to patron. 
-L I'^ih^H original search agreement in file to he sent to the BuHiness Offier 

nt tlu^ entl ol" viich moiith. 
DIA LOG Opt^rntor 

L Giistnni SrnrcMi Only. Hubtrnets $5.00 dc^poslt from amount of neareh and 
lijh; ii) hfilancu' duc^ on original find ee nnuM- eopicn^ of tin) searcdi agree- 

1,(0 
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A^ks^ patJ'on to tako Heiircli ai^rreiiu^nt to the cash register at the Return 
Derik, pay balrmce due, and return it with the cash register receipt to 
receive yeareh infurmation, 
a Return Desk Staff 

1, Rinf^H in balajige clue :uid returnH neareh n ^ement with the uaHh registp'- 
receipt tu the patron, 
a DbXLQG Operator 

i, Reeordb reueipt number on original and duplieato copy of Search Agree= 
nient. 

Gives Heareh information to patron. 
:L Files original search agreement in liie to )je sent to the Business Office 
the end of each month, 

o DI/\T.OG Operator 



be chart^ed against. 
2. (Veriry Department approval by phone), 

ImIIh out DIALOG Heareh AgrcM^mient nnd adds account ende on roiMa inv 

charge^ baek, 
■ 1 , Has employee sign, 

Prota'C'ds witli searelK 

Adds bnUmec due \A a uusttuji sc^aruh is reciuestetb 
7, Gives iMuployee duplicate copy oF aiU'^^'tjnuait nnd searcii iniormntiiHU 

ImIcs (n'igiiial searcii ngre<Mnent in lih^ to be jaait to thr nusmess ()irit!n 
at the end ol^ t^:u'h montlu 



Asks employee ru<iuesting tin- search what account code th 



e sc^a: h should 



MAXIMUM MONT 



;V iiSAGK 



1-1IAL( )c; Operator 



L RtM^ps a running acHanint ol' hnui 
iuMii's lor ihr niiHith. 



's nnd laits n 



soa rc:]n'S wlnai np 
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RK FUNDS 



o DIALOG Operiitor 

1. FillH out rt?fimci slip providod by LockheecU 

2, Brings refunci b^WpH to ihv Bui^ineHB Ofncr iha roUowing day for propdration 
of SPD, 

o BuBineys Oiliuc HtLuT 

L Makes Xerox copy at refund slip, 

'^ BendH refund nHp t^) Loakheed for crediL 

:K MarkH Gn[)y of refund Klip ^K)riginal , stani[}ri ^^puynienl appr(wutl,^^ ^^it^iiBj 
and attiiches to SPD. 

PAYING rNYOrCKH FROM LOCKHEFD 



1. HouteH by the kccoiuI working day of the month the DIALOG Search Af^ree- 
nieut and eouy of i;eareh lo|^ to the BuHine:u; Office for previouH month^H 
tranHautions, 

a. Notifies BusiueHH Office of pending refundH, 
a BuHineHH Office Staff 

L CuiiipnreH se:u'eli af^rpcnKait with invoice from Lockheed to determine cor- 
rect, eharfjc^H, 

2, StanipH invoice ai)[)roval a.!id idi'ai:^ 
:k IVlak^s Xt»rnx ca^py of invoicav 

L rMan)ares pfiilia! payiTHMit v<Mitrhr!^ for ananmt. of invoiiu^ uHinj.^ CharK<^ 

a. HeiVrh^ In SIM) and dat(^ \nr any rc^lunth: fur whicdi wr art' r«M-rivi!iK 
(: ri'dlL 

Altaidu^M (irij^innl copy nf invnicu' U) partial piiynuaif voucher. 
Fih's Xrrox i-Mpy *^f itri^oine with ccspioj; ol h>j^ 
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ThiH appeniiix pro; s u Wt't oi" Ihu niuutingH hekl and indiaatcs V.\c kind of coordination 
required in a prujeoL such an thihu A Hhl of papers proKonted jidiouteH llw dinntMnina- 
tion of Ivnowledge noncerning \\v^ project, 

IL 1 COOKDINATION MEKTINGH 

-l?y J^x DcHcription of t^Ludy to CTN meeting, Palo Alto, CaL 

Jia u^l?, 1974 DiHeuBsion of agriienicntb with partiuiputiiig library headn, Thobu 
agretmientH wore t:o be Higned by the rej^iiective ciLiCK and counties, and Lockheed, 

•JiLilv J Li J_yi£' Api)lied Coinnnuiication IleHoarch made a presentation concorning the 
data gatJiering [)ian at a training seSHion ior the librarians, 

July ^^K_Jj)t*U Cienend meeting of participating libriirirH to diseuHH initial exf^er ienci^s 
with the HyHtem. 

^\M''Lii^ Jiii- J * Arrajigenicnt;^ for oponing cerenionic**; , Han Johc. 

Augu Ht ()j 1974, Fubliuii ' 'onimittee nieetiiig at which a recoininendation ui^h niade 

to employ a pubiiuity coordinator, 

AuL^iHt il'ij^ iiYM. (uau'ral meeting of participating [ibi'aritn^ to discuHn t^Kj)eri(*ncii to 
date and review r vised evaluation plan. 

Aui^iHt liL!^ 1971. c)[)tMiing CertMnonie^^ at Han JuiU' Public Library attended by city 
dignitaries, (31 ty and County librarians, and NHl' and Locklu.'cd representatives, 

Auj^ust H)7'L nvrrsight (Committee meeting \u rt v^(*w pi ogress to ihiU\ 

Heptember n>7 The luvuls of ihe pnrlicnpating libraric^s uwl at tlu^ San Mateo 
iMhK^ational lit-a^arch (!f^ntcM' (SMlsUU) Uedwi)od City to discuss [jolicy niattcMa; Inclnd 
ing pr)ssibU' linulations In Un^ usr of Ihr^ syMtfuii and the probltMii of fei* for siM^vici^ 
A l>ia(-ing Policy U^irking Ci«)iip was o^aablished by tlie lilM^arit^H to chuil with tlu^ 
Inl t f u' f |uest ion , 

Oolohrr 10^ hrM. iOdercaioi' librai'iaus from Iho partic'ipatiiig libiarles uuM, at Ww 
Hodwond City l)!>r;n'y i<> distais:^ publirily, llu^ ovnhndiijn (juostionna i re* , and to shaia' 
thoir oHpi ■ r if Mir ; wdh Hn- ;iysl('in. 
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October 24, 1974, FerguHon, Huliner, and FirHchein met at Stanford to discuss the 
marketing effort status and strategy. In-liLrary publicity was to be strcBsed until 
after January 1, a saturation campaigii was planned for one aommuiiity in January - 
February, and some in-library media presentations were considered, 

October 25, 1974 . C, Mick and A, Ahlp^cn (ACR) met with K. Summit and O. 
Firscheln to discuss the user questionnaire and the evaluation plan. 

October 21, 1974. Frances Grant conducted an additional training period for reference 
librarjans of the participating llbrarieH to bring them up to date on some of the new 
data bases and to show some advanced search techniques. 

No vember 21^ 1074. CTN Presentation, Ski] ling Auditorium, Stanford University 
IL K, Summit, O. Firschein, F. Grant, Lockhec^d; N. DeWatli, Sim Mateo County 
Lil}rary). 

January 10^ 1975, Meeting of tlie librarians at Redwood City. The Cooper/DeWath 
tiriie study was discussed and Alice Ahlgren of ACR discussed the mechanics of 
questionnai rus. 

Fubruary 3 197:1, Meeting of Oversight Conunittee Ueview of ACR evaluatiun material 
and the fee=tur--ser\ ice policies to be used by the libriiries, 

March 19 197 Meeting at San Jose Public Library to review the Cooper/DeWath 
study. 

Mu iajlLlD Tj}. HeatiH of libraries met and retiueHted a subsidy becfmse of uue:ipeeted 
personnel costs, 

April 7^1970. Meeting with lieads librajMe^^, CTN, and Luckhc^ecl in which a S\0 por 
terminal lu)ur Hubsidy was pro[)OHCHl iov subinisHHm to NSF. 

June IDTj}. M(M>Hng of librarians to discusH pay periotl operation, 
NovemlK^r 24^ 1975, Ovt^rsight Committee meeting conct^rning the mml for phtiHiing 
for the thircl year of f,pi>ratic)n at iull fcas the need lor follow-on studies ot nonuscrs, 
and the coiitinutHi eolh'ction f)f tinu^ and cost data, 

iM'bruary j97(;. mv visit by ACIi tu oiit-or-slai <' hbrai ir^. partie ipatiiu^ iii :aiidy, 
June nvfM'sight ^InmnuifPM meMMiiig to rt^view first draft of linal reporF 
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C. 2 PRESENTATIONS AND PAPERS 

''Computerized Retrieval Comcis to tnu Public Library, Qycar Firsciiein, Lockheed 
Infornjiation Systems ; Evelyn Ilelinerj Publicity Consultant; Sally Drev/, Redwood City 
rereronce librarian; liiid Nancy DeWathj San Mateo Coiint]r' reference librarian » Bay 
Area Chapter of the Amprlcan Soeiety tor Inforniation Science, 12 Dec 1974 

"Computerised Rettieval In a Public Library Settings^' O. Firschein and R. Summit^ 
COMCON '75, IEEE Computpr Society, Siui Fnuiui^uo, California, Feb 1975 

"FactorH Afit-uLLig the Adnption ol an Online Service by the Public Library,'^ Alice E, 
Ahtgren, A8IS Midyear Conference, I^ortland, Oregon^ Jun 1975 

''Providing and Pricing Computerized Search In tlie Public Library,'' Oscar FirHchcin 
and iU)ger Summit, NSF cullt)f|uium, ''Stratci^ieH for Improving Speuial Library Effect- 

"Online Uetrieval in a Pui)lic Library HiatingJ' Roger Summit and Oftcar FlrHcheinj 
SfjccirU Libraries A^^sociation nu cting, CMiicago, ^hin 11^75 

" I'hc' DfALIB P"njt^ut," O. Firscheinj InHUtute on Library St^rviee to the liuninet^H 
Coninninity, Stale UniverHity of Nuw York, All)any, N, Y. , Jun 1U75 

"Oidint^ Suarch Scri i 'OH in Uie IHiblie Lilu'ary: Project DLMJHj'' Alice Ahigreii, 
AnuuMcnn Lil)rary A. -Knaljo!! Aimual (>Mifefa*nc'(s San I'l^anciHCo, California, Jul 

'' p!M>v^idini', IliP IMiblie witli c>nlinr Aerrss \j) Larg<^ nibliojvi^aphit* Data Bascn^," Oscar 
I'Mi':u-lnMri ami ixoget^ Summit, I'nd USA Japan ( 'ompilt rr Cc)iU"(M'imums Tokyn, Ja[)an, 
Aun Mj75 

"Thi' ) )|A . JH Hl.iuKs '' IC())^rr Siimmil, Pr/.i fsngincr riii); l-'ourdfil ( :(Mif<MMau'e, 
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^»The Corit (4' On-Lin.u Bibliugraphiu Hrarcihing, M. D. Cooper, N. A, DeWath, 
ACR"0()3-75-01, Appliod Commuiucation ReBoarch, Deeember 1975 (to ho published} 
in II reviyed form in Journal ef Libra ry AiitomatiDnj Sep 1976) 

^?On-Lino Reference RcL; iuval in a Public Library,^' R, K. Summit and O, FirMchein, 
Hi H'Gigl Librariog , Feb lliTG, pp. Ui - UG 

^^Effucts of Fee for Online RefcrcncD Retrieval in a Public Library Setting, O. 
Firschein, and K, Summit, ()7th Annual Special Libraries AsHnciation meeting, 
June in"0, Denver, Colorario, 

^M:^roviding Fee for Service Online Searchc^H Through the Public Library, A. Ahlgreiij 
;;?th Annual Special Libraries AsHOciation Meeting, Jun 1U7(). Dunv^MV CoR)rtulo* 

*^\n JjivcHtigation of the Public Library System ay a Linking Agent to Major Scientific ^ 
J'.duuatiunal, bouuiL ^uiu Environniuiuul Data Ba&ub=^' Summit and O. Fir..chein, 

NaUonal Hoience Foundation, Divinion of Science Information Seminar, ^^AltemativeH 
to ^rt-iiiitlnnal Information Transfer MechaniHms , ' ^ Wanhington, D,C. , Sep 28-29, 
197n 

*M)nlini; Rt^ferHUice Retrieval in the IHiIjHu Library: LeHsonH LearnecL i'Mrschein 
and JL IC, Hummiti Ameriean Kociety for Information Science Annuril ConfiU'enee, 
San I'rtinciHcc), ('nlifnTMiia, (kjt-l-i), l!)7ti 

^{hHiru^ liHe t)f FiUC in a Piiblit- Ribtary SelLuig,^' R. ^Inlinsnn (Han Jone IHibliu 
jabr^ary) and n, ha I'Heln an , K\i\C l^iuTH C^caifj aaMiei^ San Fianeiseo, CaUfornia, 
( )c\ \iViu 
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